Sep 28 17:52:35 devstack cinder-volume[75494]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:52:35 devstack cinder-volume[75494]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:52:35 devstack cinder-volume[75494]: we strongly recommend against using it for new projects. Sep 28 17:52:35 devstack cinder-volume[75494]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:52:35 devstack cinder-volume[75494]: framework. For more detail see Sep 28 17:52:35 devstack cinder-volume[75494]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:52:35 devstack cinder-volume[75494]: import eventlet # noqa Sep 28 17:52:38 devstack cinder-volume[75494]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:52:38 devstack cinder-volume[75494]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:52:38 devstack cinder-volume[75494]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:52:39 devstack cinder-volume[75494]: INFO dbcounter [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Registered counter for database cinder Sep 28 17:52:39 devstack cinder-volume[75494]: DEBUG oslo_db.sqlalchemy.engines [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75494) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:52:39 devstack cinder-volume[75494]: DEBUG dbcounter [-] [75494] Writer thread running {{(pid=75494) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:52:39 devstack cinder-volume[75494]: INFO cinder.rpc [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:52:39 devstack cinder-volume[75494]: INFO cinder.rpc [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:52:39 devstack cinder-volume[75494]: DEBUG oslo_db.sqlalchemy.engines [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75494) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:52:39 devstack cinder-volume[75494]: INFO cinder.volume.manager [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Determined volume DB was empty at startup. Sep 28 17:52:39 devstack cinder-volume[75494]: DEBUG cinder.volume.manager [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75494) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:52:39 devstack cinder-volume[75494]: INFO cinder.volume.manager [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:52:39 devstack cinder-volume[75494]: WARNING stevedore.named [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:52:39 devstack cinder-volume[75494]: WARNING castellan.key_manager [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:52:39 devstack cinder-volume[75494]: WARNING cinder.keymgr.conf_key_mgr [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:52:39 devstack cinder-volume[75494]: DEBUG cinder.volume.drivers.lvm [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75494) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 17:52:39 devstack cinder-volume[75494]: DEBUG oslo_concurrency.processutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_concurrency.processutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=75494) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_db.sqlalchemy.engines [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75494) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:52:40 devstack cinder-volume[75494]: INFO cinder.rpc [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 17:52:40 devstack cinder-volume[75494]: INFO cinder.rpc [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 17:52:40 devstack cinder-volume[75494]: WARNING stevedore.named [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:52:40 devstack cinder-volume[75494]: WARNING castellan.key_manager [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:52:40 devstack cinder-volume[75494]: INFO cinder.volume.manager [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_db.sqlalchemy.engines [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75494) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:52:40 devstack cinder-volume[75494]: INFO oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Starting 1 workers Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Started child 75650 {{(pid=75494) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Full set of CONF: {{(pid=75494) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] ******************************************************************************** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Configuration options gathered from: {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] ================================================================================ {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] allow_availability_zone_fallback = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] allow_compression_on_image_upload = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] allowed_direct_url_schemes = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] api_rate_limit = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] auth_strategy = keystone {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] az_cache_duration = 3600 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_availability_zone = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_host = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75650]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_stats_polling_interval = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backup_api_class = cinder.backup.api.API {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backup_name_template = backup-%s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backup_use_same_host = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backup_use_temp_snapshot = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] chap_password = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] chap_username = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_internal_tenant_project_id = 980575bd8ad64bafa54de8288647c201 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_internal_tenant_user_id = 24f34ca92a854de982a916dcfcc9422a {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cloned_volume_same_az = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cluster = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] compression_format = gzip {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] compute_api_class = cinder.compute.nova.API {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] config_dir = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] config_source = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] control_exchange = openstack {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] debug = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] default_availability_zone = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] default_group_type = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] default_volume_type = lvmdriver-1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] disk_geometry = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] driver_client_cert = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] driver_client_cert_key = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] driver_data_namespace = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] driver_ssl_cert_path = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] driver_ssl_cert_verify = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] driver_use_ssl = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] enable_force_upload = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] enable_new_services = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] enable_unsupported_driver = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] enforce_multipath_for_image_xfer = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] filter_function = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_api_insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_api_ssl_compression = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_ca_certificates_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_catalog_info = image:glance:publicURL {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_num_retries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance_request_timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] goodness_function = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] graceful_shutdown_timeout = 5 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] group_api_class = cinder.group.api.API {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] host = devstack {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_compress_on_upload = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_conversion_address_space_limit = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_conversion_cpu_limit = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_conversion_disable = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_introspection_address_space_limit = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_introspection_cpu_limit = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_upload_use_cinder_backend = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_upload_use_internal_tenant = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_volume_cache_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_volume_cache_max_count = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] init_host_max_objects_retrieval = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] instance_format = [instance: %(uuid)s] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] iscsi_target_flags = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] iscsi_write_cache = on {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] iser_helper = tgtadm {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] iser_ip_address = 192.168.122.91 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] iser_port = 3260 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_color = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_config_append = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_dir = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_options = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_rotate_interval = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_rotate_interval_type = days {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] log_rotation_type = none {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] max_age = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] max_logfile_count = 30 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] max_logfile_size_mb = 200 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] max_over_subscription_ratio = 20.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] message_reap_interval = 86400 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] message_ttl = 2592000 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] monkey_patch = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] monkey_patch_modules = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] my_ip = 192.168.122.91 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] no_snapshot_gb_quota = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] num_iser_scan_tries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] num_shell_tries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] num_volume_device_scan_tries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] nvmeof_conn_info_version = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] nvmet_ns_id = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] nvmet_port_id = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_max_limit = 1000 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_volume_ext_list = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_volume_listen_port = 8776 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_volume_use_ssl = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] osapi_volume_workers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] per_volume_size_limit = -1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] periodic_fuzzy_delay = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] periodic_interval = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] public_endpoint = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] publish_errors = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_backup_gigabytes = 1000 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_backups = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_gigabytes = 1000 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_groups = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_snapshots = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] quota_volumes = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] rate_limit_burst = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] rate_limit_except_level = CRITICAL {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] rate_limit_interval = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] reinit_driver_count = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] replication_device = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] report_discard_supported = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] report_interval = 120 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] reservation_clean_interval = 86400 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] reservation_expire = 86400 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] reserved_image_namespaces = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] reserved_percentage = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] rpc_response_timeout = 120 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] run_external_periodic_tasks = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] scst_target_driver = iscsi {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] scst_target_iqn_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75650]: INFO cinder.volume.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_down_time = 720 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] shell_completion = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] snapshot_name_template = snapshot-%s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] snapshot_same_host = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] split_loggers = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] state_path = /opt/stack/data/cinder {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] storage_availability_zone = nova {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] storage_protocol = iSCSI {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] syslog_log_facility = LOG_USER {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] target_helper = lioadm {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] target_ip_address = 192.168.122.91 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] target_port = 3260 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] target_protocol = iscsi {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] target_secondary_ip_addresses = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] trace_flags = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] transport_url = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] until_refresh = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_chap_auth = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_default_quota_class = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_journal = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_json = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_multipath_for_image_xfer = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_stderr = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] use_syslog = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] verify_glance_signatures = enabled {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_api_class = cinder.volume.api.API {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_backend_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_clear = zero {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_clear_ionice = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_clear_size = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_copy_bps_limit = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_dd_blocksize = 1M {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_name_template = volume-%s {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_service_inithost_offload = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volume_usage_audit_period = month {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] zoning_mode = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.auth_section = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.auth_type = password {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.auth_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.cache = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.interface = public {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_password = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcache_username = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.region_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.service_type = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.backend = dogpile.cache.null {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.backend_argument = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.backend_expiration_time = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.config_prefix = cache.oslo {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.debug_cache_backend = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.enable_retry_client = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.enable_socket_keepalive = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.expiration_time = 600 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_dead_retry = 300 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_pool_maxsize = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_sasl_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.password = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.proxies = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.redis_db = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.redis_server = localhost:6379 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.retry_attempts = 2 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.retry_delay = 0.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.socket_keepalive_count = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.socket_keepalive_idle = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.socket_keepalive_interval = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.socket_timeout = 1.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.tls_allowed_ciphers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.tls_cafile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.tls_certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.tls_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.tls_keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cache.username = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] coordination.backend_url = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.asyncio_connection = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.asyncio_slave_connection = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.backend = sqlalchemy {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.connection = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.connection_debug = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.connection_parameters = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.connection_recycle_time = 3600 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.connection_trace = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.db_inc_retry_interval = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.db_max_retries = 20 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.db_max_retry_interval = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.db_retry_interval = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.max_overflow = 50 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.max_pool_size = 5 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.max_retries = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.pool_timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.retry_interval = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.slave_connection = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.sqlite_synchronous = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.synchronous_reader = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] database.use_db_reconnect = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_tracing.insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.connection_string = messaging:// {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.es_doc_type = notification {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.es_scroll_size = 10000 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.es_scroll_time = 2m {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.filter_error_trace = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.hmac_keys = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.sentinel_service_name = mymaster {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.socket_timeout = 0.1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.trace_requests = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler.trace_sqlalchemy = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler_jaeger.process_tags = {} {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] profiler_otlp.service_name_prefix = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.policy_default_rule = default {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.policy_file = policy.yaml {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack sudo[75654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.group = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.helper_command = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack sudo[75654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] privsep_osbrick.user = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.group = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.helper_command = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] cinder_sys_admin.user = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.auth_section = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.auth_type = password {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.cafile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.collect_timing = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.send_service_user_token = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.split_loggers = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.tls_ciphers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] service_user.tls_min_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.auth_section = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.auth_type = password {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.collect_timing = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.region_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.split_loggers = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.tls_ciphers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] glance.tls_min_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.backend_availability_zone = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.chap_password = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.chap_username = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.disk_geometry = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.driver_client_cert = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.driver_data_namespace = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.driver_use_ssl = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.extra_capabilities = {} {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.filter_function = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.goodness_function = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.iscsi_target_flags = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.iser_helper = tgtadm {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.iser_port = 3260 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.lvm_share_target = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.lvm_type = auto {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.replication_device = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.report_discard_supported = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.target_helper = tgtadm {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.target_port = 3260 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.target_protocol = iscsi {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.trace_flags = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.use_chap_auth = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_backend_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_clear = zero {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_reports.file_event_handler = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_reports.log_dir = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.backend_host = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.chap_password = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.chap_username = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.disk_geometry = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.driver_client_cert = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.extra_capabilities = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.filter_function = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.goodness_function = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.iser_helper = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.iser_ip_address = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.iser_port = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.lvm_share_target = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.lvm_type = auto {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.num_shell_tries = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.replication_device = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.report_discard_supported = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.reserved_percentage = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.scst_target_driver = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.storage_protocol = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.target_helper = lioadm {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.target_ip_address = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.target_port = 3260 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.trace_flags = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.use_chap_auth = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_clear = zero {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_clear_size = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] lvmdriver-1.volumes_dir = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_notifications.driver = [] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] key_manager.fixed_key = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.barbican_api_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.barbican_endpoint = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.barbican_endpoint_type = public {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.barbican_region_name = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.cafile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.collect_timing = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.number_of_retries = 60 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.retry_delay = 1 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.send_service_user_token = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.split_loggers = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.tls_ciphers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.tls_min_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.verify_ssl = True {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican.verify_ssl_path = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.auth_section = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.auth_type = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.cafile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.certfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.collect_timing = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.insecure = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.keyfile = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.split_loggers = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.timeout = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.tls_ciphers = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] barbican_service_user.tls_min_version = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.approle_role_id = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.approle_secret_id = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.auth_method = approle {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.auth_path = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.kv_mountpoint = secret {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.kv_path = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.kv_version = 2 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.namespace = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.root_token_id = **** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.ssl_ca_crt_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.timeout = 60.0 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.token_file = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.token_role = None {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.use_ssl = False {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:52:40 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] ******************************************************************************** {{(pid=75494) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:52:40 devstack sudo[75654]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:40 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:41 devstack sudo[75753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:41 devstack sudo[75753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:41 devstack sudo[75753]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.360s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:52:41 devstack cinder-volume[75650]: INFO cinder.brick.local_dev.lvm [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:41 devstack sudo[75857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:52:41 devstack sudo[75857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:41 devstack sudo[75857]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG cinder.brick.local_dev.lvm [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75650) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 17:52:41 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:41 devstack sudo[75944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:41 devstack sudo[75944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:42 devstack sudo[75944]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.536s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:42 devstack sudo[76140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:42 devstack sudo[76140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:42 devstack sudo[76140]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:42 devstack sudo[76247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 17:52:42 devstack sudo[76247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:42 devstack sudo[76247]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.306s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:42 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:42 devstack sudo[76269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:52:42 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:43 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:43 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:43 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:43 devstack sudo[76327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:52:43 devstack sudo[76327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:43 devstack sudo[76327]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:43 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:43 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:43 devstack sudo[76356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:43 devstack sudo[76356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:43 devstack sudo[76356]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:43 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:43 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:43 devstack sudo[76365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:43 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:44 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:44 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:44 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:44 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:44 devstack cinder-volume[75650]: INFO cinder.volume.drivers.lvm [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:44 devstack sudo[76459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:44 devstack sudo[76459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:44 devstack sudo[76459]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:44 devstack sudo[76462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:52:44 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:44 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:44 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:44 devstack sudo[76465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:44 devstack sudo[76465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:45 devstack sudo[76465]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:45 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:45 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:45 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:45 devstack sudo[76471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:45 devstack sudo[76471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:45 devstack sudo[76471]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:45 devstack cinder-volume[75650]: INFO cinder.volume.driver [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG cinder.volume.driver [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75650) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG dbcounter [-] [75650] Writer thread running {{(pid=75650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG cinder.db.api [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Building query based on filter {{(pid=75650) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG cinder.image.image_utils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75650) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:52:45 devstack cinder-volume[75650]: INFO cinder.keymgr.migration [None req-cbcfdb64-d1a6-4d1e-82af-982cf6efabf8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:52:45 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:45 devstack sudo[76474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:52:45 devstack sudo[76474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:46 devstack sudo[76474]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:46 devstack sudo[76478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:46 devstack sudo[76478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:46 devstack sudo[76478]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:46 devstack sudo[76482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:46 devstack sudo[76482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:46 devstack sudo[76482]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:46 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:46 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:46 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG cinder.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Notifying Schedulers of capabilities ... {{(pid=75650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:52:46 devstack cinder-volume[75650]: INFO cinder.volume.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Driver initialization completed successfully. Sep 28 17:52:46 devstack cinder-volume[75650]: INFO cinder.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Initiating service 2 cleanup Sep 28 17:52:46 devstack cinder-volume[75650]: INFO cinder.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Service 2 cleanup completed. Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG cinder.service [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Creating RPC server for service cinder-volume {{(pid=75650) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:52:46 devstack cinder-volume[75650]: DEBUG cinder.service [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75650) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:52:47 devstack cinder-volume[75650]: INFO cinder.volume.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:47 devstack sudo[76489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:52:47 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:47 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:47 devstack sudo[76493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:47 devstack sudo[76493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:47 devstack sudo[76493]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:47 devstack sudo[76497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:52:47 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:47 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:47 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:52:47 devstack sudo[76503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:52:47 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:52:48 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root Sep 28 17:52:48 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:52:48 devstack cinder-volume[75650]: INFO cinder.volume.manager [None req-bcb3719d-2b1f-43f6-965c-6e58401e970d None None] Driver post RPC initialization completed successfully. Sep 28 17:52:50 devstack cinder-volume[75494]: DEBUG dbcounter [-] [75494] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75494) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:52:58 devstack cinder-volume[75650]: DEBUG dbcounter [-] [75650] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:52:58 devstack cinder-volume[75650]: DEBUG dbcounter [-] [75650] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:53:19 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager._thread_info {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:53:19 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread count: 6 {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:53:19 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread info: [<_MainThread(MainThread, started 137864832172160)>, , , , , ] {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:19 devstack sudo[79731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:54:19 devstack sudo[79731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:19 devstack sudo[79731]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:19 devstack sudo[79947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:54:19 devstack sudo[79947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:19 devstack sudo[79947]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:19 devstack sudo[80157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:54:19 devstack sudo[80157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:20 devstack sudo[80157]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:54:20 devstack sudo[80363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:54:20 devstack sudo[80363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:54:20 devstack sudo[80363]: pam_unix(sudo:session): session closed for user root Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG cinder.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Notifying Schedulers of capabilities ... {{(pid=75650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager._thread_info {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread count: 6 {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:54:20 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread info: [<_MainThread(MainThread, started 137864832172160)>, , , , , ] {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:54:58 devstack cinder-volume[75650]: DEBUG dbcounter [-] [75650] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:19 devstack sudo[83153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:55:19 devstack sudo[83153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:19 devstack sudo[83153]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:19 devstack sudo[83166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:55:19 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:19 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:19 devstack sudo[83184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:55:19 devstack sudo[83184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:20 devstack sudo[83184]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:55:20 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:55:20 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:55:20 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG cinder.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Notifying Schedulers of capabilities ... {{(pid=75650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager._thread_info {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread count: 6 {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:55:20 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread info: [<_MainThread(MainThread, started 137864832172160)>, , , , , ] {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:19 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:56:19 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:19 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:19 devstack sudo[84726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:56:19 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:19 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:19 devstack sudo[84731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:56:19 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:20 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:56:20 devstack sudo[84734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:56:20 devstack sudo[84734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:56:20 devstack sudo[84734]: pam_unix(sudo:session): session closed for user root Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG cinder.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Notifying Schedulers of capabilities ... {{(pid=75650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager._thread_info {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread count: 6 {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:56:20 devstack cinder-volume[75650]: DEBUG cinder.volume.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] thread info: [<_MainThread(MainThread, started 137864832172160)>, , , , , ] {{(pid=75650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:56:58 devstack cinder-volume[75650]: DEBUG dbcounter [-] [75650] Writing DB stats cinder:SELECT=1 {{(pid=75650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:56:58 devstack cinder-volume[75650]: DEBUG dbcounter [-] [75650] Writing DB stats cinder:UPDATE=1 {{(pid=75650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG oslo_service.periodic_task [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG cinder.volume.drivers.lvm [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Updating volume stats {{(pid=75650) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:19 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:19 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:19 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:19 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:19 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:19 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:19 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:19 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:19 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:20 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:20 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:20 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:20 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:20 devstack cinder-volume[75650]: DEBUG oslo_concurrency.processutils [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:20 devstack cinder-volume[75650]: DEBUG cinder.manager [None req-2b96c4a2-a063-49be-954e-5221f2c1cb74 None None] Notifying Schedulers of capabilities ... {{(pid=75650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:57:28 devstack cinder-volume[75494]: INFO oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Caught SIGTERM, stopping children Sep 28 17:57:28 devstack cinder-volume[75494]: DEBUG oslo_concurrency.lockutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Acquiring lock "singleton_lock" {{(pid=75494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:28 devstack cinder-volume[75494]: DEBUG oslo_concurrency.lockutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Acquired lock "singleton_lock" {{(pid=75494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:28 devstack cinder-volume[75494]: DEBUG oslo_concurrency.lockutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Releasing lock "singleton_lock" {{(pid=75494) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:28 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Stop services. {{(pid=75494) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:57:28 devstack cinder-volume[75494]: DEBUG oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Killing children. {{(pid=75494) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:57:28 devstack cinder-volume[75494]: INFO oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Waiting on 1 children to exit Sep 28 17:57:32 devstack cinder-volume[75650]: DEBUG oslo_concurrency.lockutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Acquiring lock "singleton_lock" {{(pid=75650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:32 devstack cinder-volume[75650]: DEBUG oslo_concurrency.lockutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Acquired lock "singleton_lock" {{(pid=75650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:32 devstack cinder-volume[75650]: DEBUG oslo_concurrency.lockutils [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Releasing lock "singleton_lock" {{(pid=75650) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:32 devstack cinder-volume[75650]: WARNING amqp [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:57:32 devstack cinder-volume[75650]: WARNING amqp [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:57:32 devstack cinder-volume[75494]: INFO oslo_service.backend._eventlet.service [None req-66d4587f-1cef-4f66-9d2d-1b09a8fdf4f8 None None] Child 75650 exited with status 0 Sep 28 17:57:32 devstack cinder-volume[86184]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:57:32 devstack cinder-volume[86184]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:57:32 devstack cinder-volume[86184]: we strongly recommend against using it for new projects. Sep 28 17:57:32 devstack cinder-volume[86184]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:57:32 devstack cinder-volume[86184]: framework. For more detail see Sep 28 17:57:32 devstack cinder-volume[86184]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:57:32 devstack cinder-volume[86184]: import eventlet # noqa Sep 28 17:57:34 devstack cinder-volume[86184]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:34 devstack cinder-volume[86184]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:34 devstack cinder-volume[86184]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:35 devstack cinder-volume[86184]: INFO dbcounter [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Registered counter for database cinder Sep 28 17:57:35 devstack cinder-volume[86184]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG dbcounter [-] [86184] Writer thread running {{(pid=86184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:57:36 devstack cinder-volume[86184]: INFO cinder.rpc [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:57:36 devstack cinder-volume[86184]: INFO cinder.rpc [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:36 devstack cinder-volume[86184]: INFO cinder.volume.manager [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Determined volume DB was empty at startup. Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG cinder.volume.manager [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86184) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:57:36 devstack cinder-volume[86184]: INFO cinder.volume.manager [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:57:36 devstack cinder-volume[86184]: WARNING stevedore.named [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:57:36 devstack cinder-volume[86184]: WARNING castellan.key_manager [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:36 devstack cinder-volume[86184]: WARNING cinder.keymgr.conf_key_mgr [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:36 devstack cinder-volume[86184]: INFO cinder.volume.manager [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_db.sqlalchemy.engines [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:36 devstack cinder-volume[86184]: INFO oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Starting 1 workers Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Started child 86449 {{(pid=86184) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Full set of CONF: {{(pid=86184) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] ******************************************************************************** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Configuration options gathered from: {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] ================================================================================ {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] allow_availability_zone_fallback = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] allow_compression_on_image_upload = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] allowed_direct_url_schemes = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] api_rate_limit = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] auth_strategy = keystone {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_availability_zone = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_host = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86449]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_stats_polling_interval = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backup_api_class = cinder.backup.api.API {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backup_name_template = backup-%s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backup_use_same_host = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backup_use_temp_snapshot = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] chap_password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] chap_username = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_internal_tenant_project_id = 980575bd8ad64bafa54de8288647c201 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_internal_tenant_user_id = 24f34ca92a854de982a916dcfcc9422a {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cluster = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] compression_format = gzip {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] compute_api_class = cinder.compute.nova.API {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] config_dir = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] config_source = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] control_exchange = openstack {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] debug = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] default_availability_zone = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] default_group_type = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] default_volume_type = QuobyteHD {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] disk_geometry = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] driver_client_cert = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] driver_client_cert_key = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] driver_data_namespace = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] driver_ssl_cert_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] driver_ssl_cert_verify = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] driver_use_ssl = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] enable_new_services = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] enable_unsupported_driver = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] enabled_backends = ['QuobyteHD'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] enforce_multipath_for_image_xfer = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] filter_function = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_api_insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_api_ssl_compression = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_ca_certificates_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_catalog_info = image:glance:publicURL {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_num_retries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance_request_timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] goodness_function = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] graceful_shutdown_timeout = 5 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] group_api_class = cinder.group.api.API {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] host = devstack {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_compress_on_upload = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_conversion_address_space_limit = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_conversion_cpu_limit = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_conversion_disable = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_introspection_address_space_limit = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_introspection_cpu_limit = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.remotefs [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86449) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_upload_use_cinder_backend = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_upload_use_internal_tenant = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_volume_cache_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_volume_cache_max_count = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] image_volume_cache_max_size_gb = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] init_host_max_objects_retrieval = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] instance_format = [instance: %(uuid)s] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] iscsi_target_flags = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] iscsi_write_cache = on {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] iser_helper = tgtadm {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] iser_ip_address = 192.168.122.91 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] iser_port = 3260 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_color = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_config_append = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_dir = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_options = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_rotate_interval = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_rotate_interval_type = days {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] log_rotation_type = none {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] max_age = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] max_logfile_count = 30 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] max_logfile_size_mb = 200 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] max_over_subscription_ratio = 20.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] message_reap_interval = 86400 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] message_ttl = 2592000 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] migration_create_volume_timeout_secs = 300 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] monkey_patch = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] monkey_patch_modules = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] my_ip = 192.168.122.91 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] no_snapshot_gb_quota = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] num_iser_scan_tries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] num_shell_tries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] num_volume_device_scan_tries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] nvmeof_conn_info_version = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] nvmet_ns_id = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] nvmet_port_id = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_max_limit = 1000 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_volume_ext_list = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_volume_listen = 0.0.0.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_volume_listen_port = 8776 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_volume_use_ssl = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] osapi_volume_workers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] per_volume_size_limit = -1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] periodic_fuzzy_delay = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] periodic_interval = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] project_id_regex = [0-9a-f\-]+ {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] public_endpoint = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] publish_errors = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_backup_gigabytes = 1000 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_backups = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_gigabytes = 1000 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_groups = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_snapshots = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] quota_volumes = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] rate_limit_burst = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] rate_limit_except_level = CRITICAL {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] rate_limit_interval = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] reinit_driver_count = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] replication_device = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] report_discard_supported = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] report_interval = 120 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] reservation_clean_interval = 86400 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] reservation_expire = 86400 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] reserved_image_namespaces = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] reserved_percentage = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] rpc_response_timeout = 120 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] run_external_periodic_tasks = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] scst_target_driver = iscsi {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] scst_target_iqn_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_down_time = 720 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] shell_completion = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86449) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:57:36 devstack cinder-volume[86449]: WARNING cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:57:36 devstack cinder-volume[86449]: WARNING cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] snapshot_name_template = snapshot-%s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] split_loggers = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] state_path = /opt/stack/data/cinder {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] storage_availability_zone = nova {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] storage_protocol = iSCSI {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Running cmd (subprocess): mount.quobyte {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] syslog_log_facility = LOG_USER {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] target_helper = lioadm {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] target_ip_address = 192.168.122.91 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] target_port = 3260 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] target_protocol = iscsi {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] target_secondary_ip_addresses = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] trace_flags = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] transfer_api_class = cinder.transfer.api.API {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] transport_url = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] until_refresh = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_chap_auth = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_default_quota_class = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_journal = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_json = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_multipath_for_image_xfer = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_stderr = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] use_syslog = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] verify_glance_signatures = enabled {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_api_class = cinder.volume.api.API {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_backend_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_clear = zero {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_clear_ionice = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_clear_size = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_copy_bps_limit = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_dd_blocksize = 1M {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_name_template = volume-%s {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_service_inithost_offload = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volume_usage_audit_period = month {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] zoning_mode = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_concurrency.disable_process_locking = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.auth_section = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.auth_type = password {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.auth_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.cache = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.delay_auth_decision = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.http_connect_timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.include_service_catalog = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.interface = public {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcache_username = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.region_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.service_token_roles_required = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.service_type = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.token_cache_time = 300 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.backend = dogpile.cache.null {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.backend_argument = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.backend_expiration_time = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.config_prefix = cache.oslo {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.debug_cache_backend = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.enable_retry_client = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.enable_socket_keepalive = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.expiration_time = 600 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.hashclient_retry_attempts = 2 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_dead_retry = 300 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_pool_maxsize = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_sasl_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.proxies = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.redis_db = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.redis_sentinel_service_name = mymaster {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.redis_server = localhost:6379 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.retry_attempts = 2 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.retry_delay = 0.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.socket_keepalive_count = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.socket_keepalive_idle = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.socket_keepalive_interval = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.socket_timeout = 1.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.tls_allowed_ciphers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.tls_cafile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.tls_certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.tls_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.tls_keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cache.username = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] coordination.backend_url = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.asyncio_connection = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.asyncio_slave_connection = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.backend = sqlalchemy {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.connection = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.connection_debug = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.connection_parameters = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.connection_recycle_time = 3600 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.connection_trace = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.db_inc_retry_interval = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.db_max_retries = 20 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.db_max_retry_interval = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.db_retry_interval = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.max_overflow = 50 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.max_pool_size = 5 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.max_retries = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.mysql_wsrep_sync_wait = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.pool_timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.retry_interval = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.slave_connection = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.sqlite_synchronous = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.synchronous_reader = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] database.use_db_reconnect = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_tracing.insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.connection_string = messaging:// {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.es_doc_type = notification {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.es_scroll_size = 10000 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.es_scroll_time = 2m {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.filter_error_trace = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.hmac_keys = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.sentinel_service_name = mymaster {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.socket_timeout = 0.1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.trace_requests = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler.trace_sqlalchemy = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler_jaeger.process_tags = {} {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler_jaeger.service_name_prefix = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] profiler_otlp.service_name_prefix = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.enforce_new_defaults = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.policy_default_rule = default {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.policy_file = policy.yaml {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_policy.remote_timeout = 60.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.group = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.helper_command = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] privsep_osbrick.user = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.group = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.helper_command = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] cinder_sys_admin.user = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.auth_section = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack quobyte-client[86453]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:57:36 devstack quobyte-client[86453]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.auth_type = password {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.cafile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.collect_timing = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.send_service_user_token = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.split_loggers = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] CMD "mount.quobyte" returned: 1 in 0.171s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.tls_ciphers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] service_user.tls_min_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.auth_section = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.auth_type = password {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.collect_timing = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.region_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.split_loggers = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.tls_ciphers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] glance.tls_min_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.backend_availability_zone = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86449]: INFO cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e ... Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.chap_password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.chap_username = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.disk_geometry = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.driver_client_cert = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 -c /etc/quobyte/client-cinder.cfg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.driver_client_cert_key = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.driver_data_namespace = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.driver_use_ssl = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.enable_unsupported_driver = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.extra_capabilities = {} {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.filter_function = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.goodness_function = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.iscsi_target_flags = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.iscsi_write_cache = on {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.iser_helper = tgtadm {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.iser_port = 3260 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_host = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_login = admin {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_mount_options = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_private_key = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_share_path = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_ssh_port = 22 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.num_shell_tries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.nvmet_port_id = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_client_cfg = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.quobyte_volume_url = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.replication_device = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.report_discard_supported = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.reserved_percentage = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.scst_target_driver = iscsi {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.scst_target_iqn_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.storage_protocol = iSCSI {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.target_helper = tgtadm {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.target_port = 3260 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.target_protocol = iscsi {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 -c /etc/quobyte/client-cinder.cfg Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.trace_flags = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.unique_fqdn_network = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.use_chap_auth = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_backend_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_clear = zero {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_clear_ionice = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_clear_size = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_reports.file_event_handler = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_reports.log_dir = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.backend_availability_zone = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.backend_host = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.chap_password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.chap_username = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.chiscsi_conf = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.disk_geometry = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.driver_client_cert = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.driver_client_cert_key = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.driver_data_namespace = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.driver_use_ssl = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.extra_capabilities = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.filter_function = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.goodness_function = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.iscsi_target_flags = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.iscsi_write_cache = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.iser_helper = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.iser_ip_address = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.iser_port = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.iser_target_prefix = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_host = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_login = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_mount_options = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_password = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_private_key = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_share_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_ssh_port = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.num_shell_tries = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nvmet_ns_id = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.nvmet_port_id = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.replication_device = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.report_discard_supported = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.reserved_percentage = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.scst_target_driver = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.storage_protocol = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.target_helper = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.target_ip_address = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.target_port = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.target_prefix = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.target_protocol = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.trace_flags = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.unique_fqdn_network = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.use_chap_auth = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_clear = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_clear_ionice = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_clear_size = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] QuobyteHD.volumes_dir = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.ssl_version = {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_notifications.driver = [] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_notifications.retry = -1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] oslo_messaging_notifications.transport_url = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] key_manager.fixed_key = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.barbican_api_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.barbican_endpoint = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.barbican_endpoint_type = public {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.barbican_region_name = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.cafile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.collect_timing = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.number_of_retries = 60 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.retry_delay = 1 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.send_service_user_token = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.split_loggers = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.tls_ciphers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.tls_min_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.verify_ssl = True {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican.verify_ssl_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.auth_section = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.auth_type = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.cafile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.certfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.collect_timing = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.insecure = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.keyfile = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.split_loggers = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.timeout = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.tls_ciphers = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] barbican_service_user.tls_min_version = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.approle_role_id = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.approle_secret_id = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.auth_method = approle {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.auth_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.kv_mountpoint = secret {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.kv_path = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.kv_version = 2 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.namespace = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.root_token_id = **** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.ssl_ca_crt_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.timeout = 60.0 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.token_file = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.token_role = None {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.use_ssl = False {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:36 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] ******************************************************************************** {{(pid=86184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:57:37 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.556s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:37 devstack cinder-volume[86449]: INFO cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e succeeded Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.569s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:37 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:37 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:37 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.256s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:37 devstack cinder-volume[86449]: INFO cinder.volume.driver [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.volume.driver [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86449) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_db.sqlalchemy.engines [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86449) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG dbcounter [-] [86449] Writer thread running {{(pid=86449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.db.api [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Building query based on filter {{(pid=86449) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.image.image_utils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86449) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:57:37 devstack cinder-volume[86449]: INFO cinder.keymgr.migration [None req-2105f21b-97f9-4265-b5c6-595710ad236a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:37 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:37 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:37 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.250s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:37 devstack cinder-volume[86449]: DEBUG cinder.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Notifying Schedulers of capabilities ... {{(pid=86449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:57:38 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Driver initialization completed successfully. Sep 28 17:57:38 devstack cinder-volume[86449]: INFO cinder.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Initiating service 3 cleanup Sep 28 17:57:38 devstack cinder-volume[86449]: INFO cinder.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Service 3 cleanup completed. Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG cinder.service [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Creating RPC server for service cinder-volume {{(pid=86449) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG cinder.service [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86449) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:57:38 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:38 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:38 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:38 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:38 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.265s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:38 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-4ed039de-568e-4de4-a523-94118900a8ba None None] Driver post RPC initialization completed successfully. Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:43 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:43 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:43 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.230s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:43 devstack cinder-volume[86449]: DEBUG cinder.manager [None req-55fbfb98-ddc6-4b06-aa64-ff864b8a65bb None None] Notifying Schedulers of capabilities ... {{(pid=86449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:57:46 devstack cinder-volume[86184]: DEBUG dbcounter [-] [86184] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:57:46 devstack cinder-volume[86184]: INFO oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Caught SIGTERM, stopping children Sep 28 17:57:46 devstack cinder-volume[86184]: DEBUG oslo_concurrency.lockutils [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Acquiring lock "singleton_lock" {{(pid=86184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:46 devstack cinder-volume[86184]: DEBUG oslo_concurrency.lockutils [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Acquired lock "singleton_lock" {{(pid=86184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:46 devstack cinder-volume[86184]: DEBUG oslo_concurrency.lockutils [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Releasing lock "singleton_lock" {{(pid=86184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:46 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Stop services. {{(pid=86184) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:57:46 devstack cinder-volume[86184]: DEBUG oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Killing children. {{(pid=86184) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:57:46 devstack cinder-volume[86184]: INFO oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Waiting on 1 children to exit Sep 28 17:57:48 devstack cinder-volume[86449]: DEBUG dbcounter [-] [86449] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:57:48 devstack cinder-volume[86449]: DEBUG dbcounter [-] [86449] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:57:51 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Acquiring lock "singleton_lock" {{(pid=86449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:51 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Acquired lock "singleton_lock" {{(pid=86449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:51 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Releasing lock "singleton_lock" {{(pid=86449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:51 devstack cinder-volume[86449]: WARNING amqp [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:57:51 devstack cinder-volume[86449]: WARNING amqp [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:57:51 devstack cinder-volume[86184]: INFO oslo_service.backend._eventlet.service [None req-70e8579a-b958-466f-b42a-b8ef9230debe None None] Child 86449 exited with status 0 Sep 28 17:57:52 devstack cinder-volume[86848]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:57:52 devstack cinder-volume[86848]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:57:52 devstack cinder-volume[86848]: we strongly recommend against using it for new projects. Sep 28 17:57:52 devstack cinder-volume[86848]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:57:52 devstack cinder-volume[86848]: framework. For more detail see Sep 28 17:57:52 devstack cinder-volume[86848]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:57:52 devstack cinder-volume[86848]: import eventlet # noqa Sep 28 17:57:55 devstack cinder-volume[86848]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:55 devstack cinder-volume[86848]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:55 devstack cinder-volume[86848]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:55 devstack cinder-volume[86848]: INFO dbcounter [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Registered counter for database cinder Sep 28 17:57:55 devstack cinder-volume[86848]: DEBUG oslo_db.sqlalchemy.engines [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG dbcounter [-] [86848] Writer thread running {{(pid=86848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:57:56 devstack cinder-volume[86848]: INFO cinder.rpc [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:57:56 devstack cinder-volume[86848]: INFO cinder.rpc [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_db.sqlalchemy.engines [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:56 devstack cinder-volume[86848]: INFO cinder.volume.manager [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Determined volume DB was empty at startup. Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG cinder.volume.manager [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86848) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:57:56 devstack cinder-volume[86848]: WARNING stevedore.named [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:57:56 devstack cinder-volume[86848]: WARNING castellan.key_manager [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:56 devstack cinder-volume[86848]: WARNING cinder.keymgr.conf_key_mgr [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:56 devstack cinder-volume[86848]: INFO cinder.volume.manager [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_db.sqlalchemy.engines [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:56 devstack cinder-volume[86848]: INFO oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Starting 1 workers Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Started child 87096 {{(pid=86848) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Full set of CONF: {{(pid=86848) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] ******************************************************************************** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] Configuration options gathered from: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] ================================================================================ {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] allow_availability_zone_fallback = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] allow_compression_on_image_upload = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] allowed_direct_url_schemes = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] api_rate_limit = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] auth_strategy = keystone {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_host = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_stats_polling_interval = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backup_api_class = cinder.backup.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backup_name_template = backup-%s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backup_use_same_host = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backup_use_temp_snapshot = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] chap_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] chap_username = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_internal_tenant_project_id = 980575bd8ad64bafa54de8288647c201 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_internal_tenant_user_id = 24f34ca92a854de982a916dcfcc9422a {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cluster = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] compression_format = gzip {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[87096]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] compute_api_class = cinder.compute.nova.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] config_dir = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] config_source = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] control_exchange = openstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] debug = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] default_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] default_group_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] default_volume_type = QuobyteHD {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] disk_geometry = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] driver_client_cert = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] driver_client_cert_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] driver_data_namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] driver_ssl_cert_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] driver_ssl_cert_verify = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] driver_use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] enable_new_services = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] enable_unsupported_driver = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] enabled_backends = ['QuobyteHD'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] enforce_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] filter_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_api_insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_api_ssl_compression = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_ca_certificates_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_catalog_info = image:glance:publicURL {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_num_retries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance_request_timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] goodness_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] graceful_shutdown_timeout = 5 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] group_api_class = cinder.group.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] host = devstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_compress_on_upload = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_conversion_address_space_limit = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_conversion_cpu_limit = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_conversion_disable = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_introspection_address_space_limit = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_introspection_cpu_limit = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_upload_use_cinder_backend = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_upload_use_internal_tenant = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_volume_cache_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_volume_cache_max_count = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] init_host_max_objects_retrieval = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] instance_format = [instance: %(uuid)s] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] iscsi_target_flags = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] iscsi_write_cache = on {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] iser_helper = tgtadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] iser_ip_address = 192.168.122.91 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] iser_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_color = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_config_append = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87096) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_dir = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_options = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_rotate_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_rotate_interval_type = days {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] log_rotation_type = none {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] max_age = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] max_logfile_count = 30 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] max_logfile_size_mb = 200 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] max_over_subscription_ratio = 20.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] message_reap_interval = 86400 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] message_ttl = 2592000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] monkey_patch = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] monkey_patch_modules = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] my_ip = 192.168.122.91 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] no_snapshot_gb_quota = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] num_iser_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] num_shell_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] num_volume_device_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] nvmeof_conn_info_version = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] nvmet_ns_id = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] nvmet_port_id = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_max_limit = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_volume_ext_list = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_volume_listen_port = 8776 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_volume_use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] osapi_volume_workers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] per_volume_size_limit = -1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] periodic_fuzzy_delay = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] periodic_interval = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] public_endpoint = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] publish_errors = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_backup_gigabytes = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_backups = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_gigabytes = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_groups = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_snapshots = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] quota_volumes = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] rate_limit_burst = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] rate_limit_except_level = CRITICAL {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] rate_limit_interval = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] reinit_driver_count = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] replication_device = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] report_discard_supported = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] report_interval = 120 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] reservation_clean_interval = 86400 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] reservation_expire = 86400 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] reserved_image_namespaces = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] reserved_percentage = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] rpc_response_timeout = 120 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] run_external_periodic_tasks = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] scst_target_driver = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] scst_target_iqn_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_down_time = 720 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] shell_completion = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] snapshot_name_template = snapshot-%s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] state_path = /opt/stack/data/cinder {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] storage_availability_zone = nova {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] storage_protocol = iSCSI {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] syslog_log_facility = LOG_USER {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] target_helper = lioadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] target_ip_address = 192.168.122.91 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] target_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] target_protocol = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] target_secondary_ip_addresses = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] trace_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] transport_url = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] until_refresh = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_chap_auth = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_default_quota_class = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_journal = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_json = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_stderr = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] use_syslog = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] verify_glance_signatures = enabled {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_api_class = cinder.volume.api.API {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_backend_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_clear = zero {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_clear_ionice = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_clear_size = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_copy_bps_limit = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_dd_blocksize = 1M {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_name_template = volume-%s {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_service_inithost_offload = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volume_usage_audit_period = month {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] zoning_mode = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.auth_type = password {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.auth_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.cache = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.interface = public {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87096) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:57:56 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcache_username = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.region_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.service_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.backend = dogpile.cache.null {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.backend_argument = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.backend_expiration_time = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.config_prefix = cache.oslo {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.debug_cache_backend = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.enable_retry_client = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.enable_socket_keepalive = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.expiration_time = 600 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_dead_retry = 300 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_pool_maxsize = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_sasl_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.proxies = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.redis_db = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.redis_server = localhost:6379 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.retry_attempts = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.retry_delay = 0.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.socket_keepalive_count = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.socket_keepalive_idle = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.socket_keepalive_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.socket_timeout = 1.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.tls_allowed_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.tls_cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.tls_certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.tls_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.tls_keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cache.username = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] coordination.backend_url = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.asyncio_connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.asyncio_slave_connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.backend = sqlalchemy {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.connection_debug = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.connection_parameters = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.connection_recycle_time = 3600 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.connection_trace = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.db_inc_retry_interval = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.db_max_retries = 20 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.db_max_retry_interval = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.db_retry_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.max_overflow = 50 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.max_pool_size = 5 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.max_retries = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.pool_timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.retry_interval = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.slave_connection = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.sqlite_synchronous = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.synchronous_reader = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] database.use_db_reconnect = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_tracing.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.connection_string = messaging:// {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.es_doc_type = notification {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.es_scroll_size = 10000 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.es_scroll_time = 2m {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.filter_error_trace = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.hmac_keys = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.sentinel_service_name = mymaster {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.socket_timeout = 0.1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.trace_requests = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler.trace_sqlalchemy = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler_jaeger.process_tags = {} {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] profiler_otlp.service_name_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.policy_default_rule = default {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.policy_file = policy.yaml {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.group = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.helper_command = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] privsep_osbrick.user = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.group = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.helper_command = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] cinder_sys_admin.user = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.auth_type = password {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.send_service_user_token = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.tls_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] service_user.tls_min_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.auth_type = password {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.region_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.tls_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] glance.tls_min_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.backend_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.chap_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.chap_username = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.disk_geometry = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.driver_client_cert = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.driver_data_namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.driver_use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.extra_capabilities = {} {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.filter_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.goodness_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack quobyte-client[87097]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:57:56 devstack quobyte-client[87097]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.iscsi_target_flags = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.iser_helper = tgtadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.iser_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_host = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_login = admin {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_mount_options = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_private_key = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_share_path = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.replication_device = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.report_discard_supported = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.target_helper = tgtadm {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.target_port = 3260 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.target_protocol = iscsi {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.trace_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.use_chap_auth = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_backend_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_clear = zero {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_reports.file_event_handler = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_reports.log_dir = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.backend_host = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.chap_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.chap_username = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.chiscsi_conf = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.disk_geometry = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.driver_client_cert = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.driver_use_ssl = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.extra_capabilities = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.filter_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.goodness_function = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.iser_helper = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.iser_ip_address = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.iser_port = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.iser_target_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_host = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_login = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_mount_options = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_password = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_private_key = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_share_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_ssh_port = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.num_shell_tries = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.nvmet_port_id = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.replication_device = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.report_discard_supported = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.reserved_percentage = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.scst_target_driver = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.storage_protocol = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.target_helper = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.target_ip_address = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.target_port = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.target_prefix = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.target_protocol = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.trace_flags = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.use_chap_auth = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_clear = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_clear_size = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] QuobyteHD.volumes_dir = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_notifications.driver = [] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] key_manager.fixed_key = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.barbican_api_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.barbican_endpoint = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.barbican_endpoint_type = public {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.barbican_region_name = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.number_of_retries = 60 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.retry_delay = 1 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.send_service_user_token = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.tls_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.tls_min_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.verify_ssl = True {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican.verify_ssl_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.auth_section = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.auth_type = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.cafile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.certfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.collect_timing = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.insecure = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.keyfile = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.split_loggers = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.timeout = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.tls_ciphers = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] barbican_service_user.tls_min_version = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.approle_role_id = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.approle_secret_id = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.auth_method = approle {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.auth_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.kv_mountpoint = secret {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.kv_path = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.kv_version = 2 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.namespace = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.root_token_id = **** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.ssl_ca_crt_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.timeout = 60.0 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.token_file = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.token_role = None {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.use_ssl = False {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:56 devstack cinder-volume[86848]: DEBUG oslo_service.backend._eventlet.service [None req-feee1b51-b306-4cab-a26a-7055cd41ffa9 None None] ******************************************************************************** {{(pid=86848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:57:56 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.238s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:56 devstack cinder-volume[87096]: INFO cinder.volume.driver [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.driver [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87096) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_db.sqlalchemy.engines [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writer thread running {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.db.api [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Building query based on filter {{(pid=87096) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87096) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:56 devstack cinder-volume[87096]: INFO cinder.keymgr.migration [None req-9bc16e36-b8de-4233-9810-7bc75ccbb0ab None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:57:56 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:56 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:57 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.261s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:57:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Driver initialization completed successfully. Sep 28 17:57:57 devstack cinder-volume[87096]: INFO cinder.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Initiating service 3 cleanup Sep 28 17:57:57 devstack cinder-volume[87096]: INFO cinder.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Service 3 cleanup completed. Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG cinder.service [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Creating RPC server for service cinder-volume {{(pid=87096) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG cinder.service [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87096) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:57:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:57 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:57:57 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:57 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.247s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6892b789-40a0-46fe-b126-63d98b2117b3 None None] Driver post RPC initialization completed successfully. Sep 28 17:58:06 devstack cinder-volume[86848]: DEBUG dbcounter [-] [86848] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:58:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 6 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:58:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Flow 'volume_create_manager' (378297be-1fb9-4781-98c2-bd7ea73caa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067b51ec-d72a-4b22-96dc-8a2134fc88ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067b51ec-d72a-4b22-96dc-8a2134fc88ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-35599352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324a45e7-8320-49f7-9fda-d2b6a745f5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61b5feb0149457fbcbb39cde058c49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:59:21Z,use_quota=True,user_id='3c7a633733d1455ab81b281c14a6bd74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8840bb73-16a8-4037-9204-7ac2c93f56f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8840bb73-16a8-4037-9204-7ac2c93f56f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a971234a-0985-41c9-9ef3-08194c0fb5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a971234a-0985-41c9-9ef3-08194c0fb5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324a45e7-8320-49f7-9fda-d2b6a745f5a3', 'volume_name': 'volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977c0814-31c7-4c4d-9c99-067e4051d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977c0814-31c7-4c4d-9c99-067e4051d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a204d0-2e08-4f24-b02e-a1417f21e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:21 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Volume 324a45e7-8320-49f7-9fda-d2b6a745f5a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3', 'volume_size': 1} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-35599352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324a45e7-8320-49f7-9fda-d2b6a745f5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f61b5feb0149457fbcbb39cde058c49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:59:21Z,use_quota=True,user_id='3c7a633733d1455ab81b281c14a6bd74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Creating volume 324a45e7-8320-49f7-9fda-d2b6a745f5a3 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:59:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:59:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:59:22 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 17:59:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:22 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 1073741824 Sep 28 17:59:22 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:23 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 1073741824" returned: 0 in 1.754s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:23 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:59:23 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:24 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 Sep 28 17:59:24 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:24 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.895s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 6 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:59:24 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3" returned: 0 in 0.956s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] <== create_volume: return (2918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.926s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a204d0-2e08-4f24-b02e-a1417f21e35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16a8d5d-3aa1-49ff-8921-cc598912bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:25 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Volume volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 (324a45e7-8320-49f7-9fda-d2b6a745f5a3): created successfully Sep 28 17:59:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16a8d5d-3aa1-49ff-8921-cc598912bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Flow 'volume_create_manager' (378297be-1fb9-4781-98c2-bd7ea73caa37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:59:25 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-eaee9f3b-6398-437c-8506-b4e63bfaeb5c tempest-DeleteServersTestJSON-2026307773 None] Created volume successfully. Sep 28 17:59:33 devstack cinder-volume[87096]: WARNING py.warnings [req-5fd3600a-6a55-45a4-804b-fbe754d196f1 req-a42c8d2d-81b4-4754-ab26-64628702c34b tempest-DeleteServersTestJSON-2026307773 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 17:59:33 devstack cinder-volume[87096]: .first() Sep 28 17:59:33 devstack cinder-volume[87096]: Sep 28 17:59:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-5fd3600a-6a55-45a4-804b-fbe754d196f1 req-a42c8d2d-81b4-4754-ab26-64628702c34b tempest-DeleteServersTestJSON-2026307773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-5fd3600a-6a55-45a4-804b-fbe754d196f1 req-a42c8d2d-81b4-4754-ab26-64628702c34b tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-5fd3600a-6a55-45a4-804b-fbe754d196f1 req-a42c8d2d-81b4-4754-ab26-64628702c34b tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-5fd3600a-6a55-45a4-804b-fbe754d196f1 req-a42c8d2d-81b4-4754-ab26-64628702c34b tempest-DeleteServersTestJSON-2026307773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cb85958-7051-4f3e-aabf-fe5104f72196', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:59:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-5fd3600a-6a55-45a4-804b-fbe754d196f1 req-a42c8d2d-81b4-4754-ab26-64628702c34b tempest-DeleteServersTestJSON-2026307773 None] attachment_update completed successfully. Sep 28 17:59:38 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:59:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Flow 'volume_create_manager' (527db5eb-ffb3-470f-99a9-8e16785d6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:59:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd38b593-653b-45b7-9353-57e8d40a3502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd38b593-653b-45b7-9353-57e8d40a3502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-671500551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2472af-2004-4e83-a5d5-fc39a210776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb7c6f999594376ac4c2e8d8613ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:59:39Z,use_quota=True,user_id='5b5e0ac639734b4f87ee861fa7d71618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58313309-1b0b-4f19-a7c9-500308fb3e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58313309-1b0b-4f19-a7c9-500308fb3e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab777ba7-b8da-469b-9bc1-5a155962ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab777ba7-b8da-469b-9bc1-5a155962ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2472af-2004-4e83-a5d5-fc39a210776f', 'volume_name': 'volume-ce2472af-2004-4e83-a5d5-fc39a210776f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a975f896-7a4b-4984-8c82-66a1fbaaf3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a975f896-7a4b-4984-8c82-66a1fbaaf3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba00126-d51f-4b05-bd53-815779b115af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Volume ce2472af-2004-4e83-a5d5-fc39a210776f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2472af-2004-4e83-a5d5-fc39a210776f', 'volume_size': 1} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-671500551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2472af-2004-4e83-a5d5-fc39a210776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcb7c6f999594376ac4c2e8d8613ebbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:59:39Z,use_quota=True,user_id='5b5e0ac639734b4f87ee861fa7d71618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Creating volume ce2472af-2004-4e83-a5d5-fc39a210776f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:59:39 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:39 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f 1073741824 Sep 28 17:59:39 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Flow 'volume_create_manager' (203cf9f9-af8f-4c73-ae4e-03caaeeacfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d2a7d8-2c13-4f1e-8377-ab2ae1bd6938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d2a7d8-2c13-4f1e-8377-ab2ae1bd6938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-811395534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d812a8-f9d2-4108-b8d4-1ea7273fabb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cc4a58088a4b0189eefa6eab2fea31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:59:39Z,use_quota=True,user_id='af3097b7c49547658885ac07a73b9ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1da579-2e23-49c5-9513-2804c6f1f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1da579-2e23-49c5-9513-2804c6f1f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b17b816-dc25-471b-82d2-40d97993a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b17b816-dc25-471b-82d2-40d97993a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d812a8-f9d2-4108-b8d4-1ea7273fabb1', 'volume_name': 'volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4a68f9-d91e-4a28-a0bc-7e1ccd5c2328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4a68f9-d91e-4a28-a0bc-7e1ccd5c2328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb1d188-7f30-4bd4-9de0-29ebc34b4f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Volume 51d812a8-f9d2-4108-b8d4-1ea7273fabb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1', 'volume_size': 1} Sep 28 17:59:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:40 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f 1073741824" returned: 0 in 1.833s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:41 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f Sep 28 17:59:41 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:41 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f" returned: 0 in 0.827s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] <== create_volume: return (2753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.757s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-811395534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d812a8-f9d2-4108-b8d4-1ea7273fabb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31cc4a58088a4b0189eefa6eab2fea31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:59:39Z,use_quota=True,user_id='af3097b7c49547658885ac07a73b9ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Creating volume 51d812a8-f9d2-4108-b8d4-1ea7273fabb1 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:59:41 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba00126-d51f-4b05-bd53-815779b115af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2472af-2004-4e83-a5d5-fc39a210776f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f0d748-49e5-4b45-96cd-64069e0ce0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Volume volume-ce2472af-2004-4e83-a5d5-fc39a210776f (ce2472af-2004-4e83-a5d5-fc39a210776f): created successfully Sep 28 17:59:42 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 1073741824 Sep 28 17:59:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f0d748-49e5-4b45-96cd-64069e0ce0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:42 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Flow 'volume_create_manager' (527db5eb-ffb3-470f-99a9-8e16785d6a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:59:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-74bdbe54-b6a6-4d1a-bb0a-a9c626757d85 tempest-VolumesAdminNegativeTest-1992215379 None] Created volume successfully. Sep 28 17:59:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-b914b7ab-a68a-4cff-9df9-121d2d7e3bcc req-1ac1bf33-6e3d-4e56-ad03-f1ebe8c6300c tempest-DeleteServersTestJSON-2026307773 None] Terminate volume connection completed successfully. Sep 28 17:59:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-b914b7ab-a68a-4cff-9df9-121d2d7e3bcc req-1ac1bf33-6e3d-4e56-ad03-f1ebe8c6300c tempest-DeleteServersTestJSON-2026307773 None] Deleting attachment 4cb85958-7051-4f3e-aabf-fe5104f72196. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:59:43 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 1073741824" returned: 0 in 1.156s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:43 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 Sep 28 17:59:43 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:43 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1" returned: 0 in 0.368s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb1d188-7f30-4bd4-9de0-29ebc34b4f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae8da74-74a6-48c4-b0c3-78b77f3ea0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:59:43 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Volume volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 (51d812a8-f9d2-4108-b8d4-1ea7273fabb1): created successfully Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae8da74-74a6-48c4-b0c3-78b77f3ea0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:59:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Flow 'volume_create_manager' (203cf9f9-af8f-4c73-ae4e-03caaeeacfbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:59:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e55011d4-aa6d-45fc-938f-4d5c620727e9 tempest-ServerRescueNegativeTestJSON-126073827 None] Created volume successfully. Sep 28 17:59:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Acquiring lock "cinder-ce2472af-2004-4e83-a5d5-fc39a210776f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:59:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Lock "cinder-ce2472af-2004-4e83-a5d5-fc39a210776f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:59:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Acquiring lock "cinder-quobyte-ce2472af-2004-4e83-a5d5-fc39a210776f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:59:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Lock "cinder-quobyte-ce2472af-2004-4e83-a5d5-fc39a210776f" acquired by "delete_volume" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:59:45 devstack cinder-volume[87096]: INFO oslo.privsep.daemon [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpl9ljt5vy/privsep.sock'] Sep 28 17:59:45 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpl9ljt5vy/privsep.sock Sep 28 17:59:45 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Acquiring lock "cinder-324a45e7-8320-49f7-9fda-d2b6a745f5a3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:59:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Lock "cinder-324a45e7-8320-49f7-9fda-d2b6a745f5a3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:59:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Acquiring lock "cinder-quobyte-324a45e7-8320-49f7-9fda-d2b6a745f5a3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:59:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Lock "cinder-quobyte-324a45e7-8320-49f7-9fda-d2b6a745f5a3" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:59:47 devstack cinder-volume[87096]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:59:48 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:48 devstack cinder-volume[87096]: INFO oslo.privsep.daemon [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Spawned new privsep daemon via rootwrap Sep 28 17:59:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Accepted privsep connection to /tmp/tmpl9ljt5vy/privsep.sock {{(pid=87096) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:59:48 devstack cinder-volume[87096]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:59:48 devstack cinder-volume[87096]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:59:48 devstack cinder-volume[87096]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:59:48 devstack cinder-volume[87096]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88847 Sep 28 17:59:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de77425-8a88-4bb8-973f-2409c362b80a]: (2,) {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:59:48 devstack cinder-volume[87096]: WARNING oslo_privsep.priv_context [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] privsep daemon already running Sep 28 17:59:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be72cc-5741-427e-99a0-23516862cddc]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:59:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521672a-527d-47cd-b4cc-68208620f4ae]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:59:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:48 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f Sep 28 17:59:48 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:48 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 Sep 28 17:59:48 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:49 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3" returned: 0 in 0.849s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:49 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3 Sep 28 17:59:49 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:49 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f" returned: 0 in 1.239s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:49 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f Sep 28 17:59:49 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:49 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-324a45e7-8320-49f7-9fda-d2b6a745f5a3" returned: 0 in 0.621s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Lock "cinder-quobyte-324a45e7-8320-49f7-9fda-d2b6a745f5a3" released by "delete_volume" :: held 3.228s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:59:50 devstack cinder-volume[87096]: WARNING cinder.quota [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:59:50 devstack cinder-volume[87096]: WARNING cinder.quota [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Created reservations ['3403a68e-5e52-4771-9f31-4bec277b2b48', 'eb11a56c-2399-4fb5-a5c9-1f5775d0b22b', 'acd35c4e-2068-420d-a666-11448bb97b43', '6b1488f7-2c1b-42fa-a9c6-814257a81636'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:50 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:59:50 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:50 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ce2472af-2004-4e83-a5d5-fc39a210776f" returned: 0 in 0.873s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Lock "cinder-quobyte-ce2472af-2004-4e83-a5d5-fc39a210776f" released by "delete_volume" :: held 5.331s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:59:50 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Created reservations ['92f2eeee-fcfd-4658-85a8-e26aaba84d87', '4d71297f-0446-459f-8987-04dfd06a38e5', '11e991e6-094f-4976-855d-4131e1913841', '624467d6-29bf-429d-a60a-6b65ae497cac'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.553s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:59:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Deleted volume successfully. Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596e55c8-0892-41dd-ad68-3f8381595bb5 tempest-DeleteServersTestJSON-2026307773 None] Lock "cinder-324a45e7-8320-49f7-9fda-d2b6a745f5a3-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:59:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:51 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 17:59:51 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:51 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.484s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:51 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:59:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Deleted volume successfully. Sep 28 17:59:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68d647fd-16ae-4bdc-b101-5fa0805cadfc tempest-VolumesAdminNegativeTest-1992215379 None] Lock "cinder-ce2472af-2004-4e83-a5d5-fc39a210776f-delete_volume" released by "delete_volume" :: held 6.484s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:00:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=30,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=5 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:00:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Acquiring lock "cinder-51d812a8-f9d2-4108-b8d4-1ea7273fabb1-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "cinder-51d812a8-f9d2-4108-b8d4-1ea7273fabb1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Acquiring lock "cinder-quobyte-51d812a8-f9d2-4108-b8d4-1ea7273fabb1" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:00:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "cinder-quobyte-51d812a8-f9d2-4108-b8d4-1ea7273fabb1" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:00:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[73258383-a317-421d-ab04-d326d15acb7c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:00:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:21 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 Sep 28 18:00:21 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:22 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1" returned: 0 in 0.646s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:22 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1 Sep 28 18:00:22 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:22 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51d812a8-f9d2-4108-b8d4-1ea7273fabb1" returned: 0 in 0.486s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "cinder-quobyte-51d812a8-f9d2-4108-b8d4-1ea7273fabb1" released by "delete_volume" :: held 1.255s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Created reservations ['e4d05d91-cbf0-4d29-9bc4-40faeac4cc93', 'd4684e39-80a0-452e-861a-24a336696485', '87c35e6a-e702-438e-b033-ce4f72462138', '7072d630-11fc-4524-a602-777c85ccf914'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:22 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:00:22 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:23 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.350s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Deleted volume successfully. Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fee2201b-fcd5-4f35-98d9-35e642643163 tempest-ServerRescueNegativeTestJSON-126073827 None] Lock "cinder-51d812a8-f9d2-4108-b8d4-1ea7273fabb1-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:23 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:00:23 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:24 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.596s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:00:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 8 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:00:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:00:32 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:00:33 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:00:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1ac71b64-8a00-4bac-a4de-e6251b85a36a tempest-GroupSnapshotsV319Test-1288145216 None] Group tempest-GroupSnapshotsV319Test-Group-485107249: creating Sep 28 18:00:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1ac71b64-8a00-4bac-a4de-e6251b85a36a tempest-GroupSnapshotsV319Test-1288145216 None] Group tempest-GroupSnapshotsV319Test-Group-485107249: created successfully Sep 28 18:00:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1ac71b64-8a00-4bac-a4de-e6251b85a36a tempest-GroupSnapshotsV319Test-1288145216 None] Create group completed successfully. Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Flow 'volume_create_manager' (f8d83a8a-d2c9-4489-af62-b30180cd0396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b5f59-1043-472d-8082-4b8709bcf7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b5f59-1043-472d-8082-4b8709bcf7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1869407474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03b6154-6e8e-4a06-ab88-56fbf85ab0d4,host='devstack@QuobyteHD#QuobyteHD',id=0e292fcf-6531-4a99-88ad-a1cf7cb869f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21c74bc3f1f4ec49984084a279e4def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:55Z,use_quota=True,user_id='0347b23ed19b4c4f883f4fffbaf36697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75997acf-e71e-4c98-82dd-1f75ed0ff9eb),volume_type_id=75997acf-e71e-4c98-82dd-1f75ed0ff9eb)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fde6a11-69d2-4317-9492-8d628b3a03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fde6a11-69d2-4317-9492-8d628b3a03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d6bd60-4172-4ef9-a9bf-12376e5529a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d6bd60-4172-4ef9-a9bf-12376e5529a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e292fcf-6531-4a99-88ad-a1cf7cb869f3', 'volume_name': 'volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10b0ce8-a303-4d18-ae1a-9bf882b5c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10b0ce8-a303-4d18-ae1a-9bf882b5c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0cdca9-9f8e-472e-b412-bdda7f47f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Volume 0e292fcf-6531-4a99-88ad-a1cf7cb869f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3', 'volume_size': 1} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b03b6154-6e8e-4a06-ab88-56fbf85ab0d4,created_at=2026-09-28T16:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1869407474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03b6154-6e8e-4a06-ab88-56fbf85ab0d4,host='devstack@QuobyteHD#QuobyteHD',id=0e292fcf-6531-4a99-88ad-a1cf7cb869f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21c74bc3f1f4ec49984084a279e4def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:00:55Z,use_quota=True,user_id='0347b23ed19b4c4f883f4fffbaf36697',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75997acf-e71e-4c98-82dd-1f75ed0ff9eb),volume_type_id=75997acf-e71e-4c98-82dd-1f75ed0ff9eb)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Creating volume 0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:00:55 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:55 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 1073741824 Sep 28 18:00:55 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:55 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 1073741824" returned: 0 in 0.662s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:55 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 Sep 28 18:00:55 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:56 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" returned: 0 in 0.643s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b0cdca9-9f8e-472e-b412-bdda7f47f10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f11c940-1c60-41d5-9416-b9789683dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:00:56 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Volume volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 (0e292fcf-6531-4a99-88ad-a1cf7cb869f3): created successfully Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f11c940-1c60-41d5-9416-b9789683dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:00:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Flow 'volume_create_manager' (f8d83a8a-d2c9-4489-af62-b30180cd0396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:00:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-92892a3b-3559-4dad-83e0-5812db88f5fe tempest-GroupSnapshotsV319Test-1288145216 None] Created volume successfully. Sep 28 18:00:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] GroupSnapshot b826d433-099d-4143-be5c-0dca45976ab6: creating. Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Group snapshot b826d433-099d-4143-be5c-0dca45976ab6: creating. {{(pid=87096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Creating offline snapshot 88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 of volume 0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5190da56-1423-49de-889c-34d6ccf27a3b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:58 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 Sep 28 18:00:58 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:58 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" returned: 0 in 0.431s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:58 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 1G Sep 28 18:00:58 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:59 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 1G" returned: 0 in 0.630s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:59 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 Sep 28 18:00:59 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:59 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" returned: 0 in 0.362s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:59 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:00:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:59 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 Sep 28 18:00:59 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:00 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:00 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info Sep 28 18:01:00 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:00 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:00 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:01:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:00 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info Sep 28 18:01:00 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:00 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.info" returned: 0 in 0.327s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c0a92cbe-f82f-438c-afc3-e0a015fcc953 tempest-GroupSnapshotsV319Test-1288145216 None] group_snapshot b826d433-099d-4143-be5c-0dca45976ab6: created successfully Sep 28 18:01:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] group_snapshot b826d433-099d-4143-be5c-0dca45976ab6: deleting Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] group_snapshot b826d433-099d-4143-be5c-0dca45976ab6: deleting {{(pid=87096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "cinder-quobyte-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "cinder-quobyte-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "cinder-quobyte-88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "cinder-quobyte-88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Deleting offline snapshot 88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 of volume 0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] snapshot_file for this snap is: volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de50b9f-188b-4fb8-8678-bc90dab4df18]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:02 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 Sep 28 18:01:02 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:02 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" returned: 0 in 0.465s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[755984a3-9aa1-40bb-a44f-ced097c9ecc4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:03 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 Sep 28 18:01:03 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:03 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" returned: 0 in 0.600s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:03 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 Sep 28 18:01:03 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:04 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" returned: 0 in 0.480s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:04 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1 Sep 28 18:01:04 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:04 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3.88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" returned: 0 in 0.309s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "cinder-quobyte-88bd2c4b-365e-4aea-9cbc-d62d4bf54ce1" released by "_delete_snapshot" :: held 2.061s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "cinder-quobyte-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" released by "delete_snapshot" :: held 2.101s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:04 devstack cinder-volume[87096]: WARNING cinder.quota [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1927064172 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1927064172, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:01:04 devstack cinder-volume[87096]: WARNING cinder.quota [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1927064172 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1927064172, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] Created reservations ['6c1e41c9-0152-4007-926a-5d005b31a580', '4d6ca1f5-1d05-4152-8c32-21200ca18819', 'f16942e7-e511-40cd-86ef-db98a6cc1e9b', '804a30e4-bdee-4580-a21f-9fd6abd975f2'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9bbba8ff-b7cb-4511-9960-336e019614b6 tempest-GroupSnapshotsV319Test-1288145216 None] group_snapshot b826d433-099d-4143-be5c-0dca45976ab6: deleted successfully Sep 28 18:01:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "cinder-quobyte-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "cinder-quobyte-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf406790-6c6d-495b-a9e3-fc535bb13f7a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:05 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 Sep 28 18:01:05 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:05 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" returned: 0 in 0.661s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:05 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3 Sep 28 18:01:05 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:06 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "cinder-quobyte-0e292fcf-6531-4a99-88ad-a1cf7cb869f3" released by "delete_volume" :: held 1.081s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Created reservations ['83462384-ee86-4835-85e8-6214281f605c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:06 devstack cinder-volume[87096]: WARNING cinder.quota [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1927064172 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1927064172, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Created reservations ['d55a41b2-fb6c-4c2c-b869-470b0df2dce5', 'cd0bc31b-5209-450c-8251-dae8ef4853d0', '2a3f72fe-b015-4497-a337-f4d7f0866920', '18a34cbf-586c-44c0-832a-7c12f2a559c6'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:06 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:01:06 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:06 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:06 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fe450ae4-3136-47b3-beed-9209b6a45f97 tempest-GroupSnapshotsV319Test-1288145216 None] Delete group completed successfully. Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Flow 'volume_create_manager' (3680382c-034e-428b-8890-1ae97e7442c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316da61b-c86d-45fb-a488-f9f3218a8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316da61b-c86d-45fb-a488-f9f3218a8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1130546274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85375504-a7e6-46ea-bc71-824f1feeda18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419375d78844e88b478e0b98052fb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:07Z,use_quota=True,user_id='9b7cc989f312490d8a5632af11d9d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a8b257-c16a-4900-9756-df75266019e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a8b257-c16a-4900-9756-df75266019e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0899ae-29da-48b2-a666-21cb4565e40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0899ae-29da-48b2-a666-21cb4565e40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85375504-a7e6-46ea-bc71-824f1feeda18', 'volume_name': 'volume-85375504-a7e6-46ea-bc71-824f1feeda18', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bacd7a-d201-4331-a15f-9bd5d6d5ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bacd7a-d201-4331-a15f-9bd5d6d5ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f908fe9-82f9-43aa-91c5-9e3af9c15e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:07 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Volume 85375504-a7e6-46ea-bc71-824f1feeda18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85375504-a7e6-46ea-bc71-824f1feeda18', 'volume_size': 1} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1130546274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85375504-a7e6-46ea-bc71-824f1feeda18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419375d78844e88b478e0b98052fb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:07Z,use_quota=True,user_id='9b7cc989f312490d8a5632af11d9d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Creating volume 85375504-a7e6-46ea-bc71-824f1feeda18 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:07 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:01:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:07 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 1073741824 Sep 28 18:01:07 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 1073741824" returned: 0 in 0.709s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:08 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 Sep 28 18:01:08 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18" returned: 0 in 0.349s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f908fe9-82f9-43aa-91c5-9e3af9c15e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85375504-a7e6-46ea-bc71-824f1feeda18', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bfa83a-1ff7-4b4e-b8e1-981ac72dcd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:08 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Volume volume-85375504-a7e6-46ea-bc71-824f1feeda18 (85375504-a7e6-46ea-bc71-824f1feeda18): created successfully Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43bfa83a-1ff7-4b4e-b8e1-981ac72dcd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Flow 'volume_create_manager' (3680382c-034e-428b-8890-1ae97e7442c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6eb28fad-ed9e-4984-99dc-97e1dc6b27b8 tempest-AttachVolumeNegativeTest-1944563036 None] Created volume successfully. Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ed11027-adc2-4674-beb5-ad65f0e9a633 req-92266292-fcda-4d50-9dfa-d74587353a9a tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ed11027-adc2-4674-beb5-ad65f0e9a633 req-92266292-fcda-4d50-9dfa-d74587353a9a tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ed11027-adc2-4674-beb5-ad65f0e9a633 req-92266292-fcda-4d50-9dfa-d74587353a9a tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ed11027-adc2-4674-beb5-ad65f0e9a633 req-92266292-fcda-4d50-9dfa-d74587353a9a tempest-AttachVolumeNegativeTest-1944563036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-85375504-a7e6-46ea-bc71-824f1feeda18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c033ed0-3ad5-42af-b928-a515a5f0a239', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:01:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-4ed11027-adc2-4674-beb5-ad65f0e9a633 req-92266292-fcda-4d50-9dfa-d74587353a9a tempest-AttachVolumeNegativeTest-1944563036 None] attachment_update completed successfully. Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Flow 'volume_create_manager' (d5f0b9a4-4c25-41b9-946f-97b9c1881f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d88410-8c2b-429e-bc1a-d7c5a623f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d88410-8c2b-429e-bc1a-d7c5a623f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-334255308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e189ac5-d5d1-4274-814d-f725c6db4e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8b8250bb8b4f72a366615b92e299bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:11Z,use_quota=True,user_id='63d9654fb68e4a49bf11838925c8dfbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ce6fae-399b-4944-9b1f-76c9b51f4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ce6fae-399b-4944-9b1f-76c9b51f4f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd470dc7-715a-43e3-acd0-d1c96966f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd470dc7-715a-43e3-acd0-d1c96966f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e189ac5-d5d1-4274-814d-f725c6db4e87', 'volume_name': 'volume-4e189ac5-d5d1-4274-814d-f725c6db4e87', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fefd23-d723-4d4f-8d6e-74f342df84b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fefd23-d723-4d4f-8d6e-74f342df84b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac62436b-28ce-40b6-a933-c53f7fb080a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:11 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Volume 4e189ac5-d5d1-4274-814d-f725c6db4e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e189ac5-d5d1-4274-814d-f725c6db4e87', 'volume_size': 1} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-334255308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e189ac5-d5d1-4274-814d-f725c6db4e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8b8250bb8b4f72a366615b92e299bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:11Z,use_quota=True,user_id='63d9654fb68e4a49bf11838925c8dfbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Creating volume 4e189ac5-d5d1-4274-814d-f725c6db4e87 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:11 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:01:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:11 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 1073741824 Sep 28 18:01:11 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:12 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 1073741824" returned: 0 in 0.744s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:12 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 Sep 28 18:01:12 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:12 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87" returned: 0 in 0.304s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac62436b-28ce-40b6-a933-c53f7fb080a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e189ac5-d5d1-4274-814d-f725c6db4e87', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744f089d-5dd9-4bc1-94d4-1b5fc850a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:12 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Volume volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 (4e189ac5-d5d1-4274-814d-f725c6db4e87): created successfully Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744f089d-5dd9-4bc1-94d4-1b5fc850a53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Flow 'volume_create_manager' (d5f0b9a4-4c25-41b9-946f-97b9c1881f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:12 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fa2d9226-b40a-41da-ba7e-d83f47b17282 tempest-AttachVolumeTestJSON-1550402496 None] Created volume successfully. Sep 28 18:01:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-bbb490ce-0793-4359-9dd5-1f2bd330ea69 req-24de8eb6-e655-422b-acb2-c6de41f8c973 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-bbb490ce-0793-4359-9dd5-1f2bd330ea69 req-24de8eb6-e655-422b-acb2-c6de41f8c973 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-bbb490ce-0793-4359-9dd5-1f2bd330ea69 req-24de8eb6-e655-422b-acb2-c6de41f8c973 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-bbb490ce-0793-4359-9dd5-1f2bd330ea69 req-24de8eb6-e655-422b-acb2-c6de41f8c973 tempest-AttachVolumeTestJSON-1550402496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-4e189ac5-d5d1-4274-814d-f725c6db4e87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00df39d7-d708-47a8-a79d-561f70191937', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:01:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-bbb490ce-0793-4359-9dd5-1f2bd330ea69 req-24de8eb6-e655-422b-acb2-c6de41f8c973 tempest-AttachVolumeTestJSON-1550402496 None] attachment_update completed successfully. Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Flow 'volume_create_manager' (06019475-54b9-480d-8015-fc141518eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e23247a-c378-42be-aa17-f5e4fd0861b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e23247a-c378-42be-aa17-f5e4fd0861b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2113797842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3ea435-35fc-4c1c-aac1-d94639cb2a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49186ae76f7f47f79bd3d6d31b2e6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:15Z,use_quota=True,user_id='f7af40c9f78f48518556f3a81ee18d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fadbc18-a800-4b50-bb66-53b4657b8c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fadbc18-a800-4b50-bb66-53b4657b8c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8d2e2f-e679-420e-adab-7c97bbf88591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8d2e2f-e679-420e-adab-7c97bbf88591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3ea435-35fc-4c1c-aac1-d94639cb2a34', 'volume_name': 'volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba2f266-f361-4a56-bab3-689ecd16a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba2f266-f361-4a56-bab3-689ecd16a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38471d95-5b01-4478-ada7-9b54f15802e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Volume ed3ea435-35fc-4c1c-aac1-d94639cb2a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34', 'volume_size': 1} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2113797842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3ea435-35fc-4c1c-aac1-d94639cb2a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49186ae76f7f47f79bd3d6d31b2e6746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:15Z,use_quota=True,user_id='f7af40c9f78f48518556f3a81ee18d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Creating volume ed3ea435-35fc-4c1c-aac1-d94639cb2a34 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:15 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:01:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:15 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 1073741824 Sep 28 18:01:15 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:16 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 1073741824" returned: 0 in 0.589s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:16 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 Sep 28 18:01:16 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6e3ed7cb-82c6-4e01-ae02-b7a7ef3fcf9f tempest-GroupsV320Test-1923039742 None] Group tempest-GroupsV320Test-Group-845302376: creating Sep 28 18:01:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6e3ed7cb-82c6-4e01-ae02-b7a7ef3fcf9f tempest-GroupsV320Test-1923039742 None] Group tempest-GroupsV320Test-Group-845302376: created successfully Sep 28 18:01:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6e3ed7cb-82c6-4e01-ae02-b7a7ef3fcf9f tempest-GroupsV320Test-1923039742 None] Create group completed successfully. Sep 28 18:01:16 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34" returned: 0 in 0.335s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38471d95-5b01-4478-ada7-9b54f15802e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad979ad7-ddcc-4622-93a1-39ff7d0bcdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:16 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Volume volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 (ed3ea435-35fc-4c1c-aac1-d94639cb2a34): created successfully Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad979ad7-ddcc-4622-93a1-39ff7d0bcdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Flow 'volume_create_manager' (06019475-54b9-480d-8015-fc141518eff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a07aaa36-598d-4bf8-aed3-346db14d4001 tempest-TaggedAttachmentsTest-1630347113 None] Created volume successfully. Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Created reservations ['f6efc14e-641a-43a3-a9bc-89c967b81fcd'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:18 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:01:18 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:18 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.445s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:18 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:18 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-de28d7f7-eedf-4bf0-881c-d7a8481d117b tempest-GroupsV320Test-1923039742 None] Delete group completed successfully. Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:23 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:01:23 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:24 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.559s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:28 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=51,cinder:UPDATE=37,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:28 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=49,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:30 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:01:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Flow 'volume_create_manager' (10974203-457b-4811-a369-268cc6030dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a051d1-b39f-4523-8590-742788d6f126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a051d1-b39f-4523-8590-742788d6f126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-223737888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f6fa7-0f61-429b-b5c8-5ea28a6a4506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997c467dec554c419d6426b1a8ae16f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:31Z,use_quota=True,user_id='18f3cd7f35ef48fe8fe346ec71b90725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0b14c5-1de2-425c-bd9d-81d926bcadbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0b14c5-1de2-425c-bd9d-81d926bcadbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30502a49-dcc0-4a3e-a74f-5f51de5e92c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30502a49-dcc0-4a3e-a74f-5f51de5e92c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921f6fa7-0f61-429b-b5c8-5ea28a6a4506', 'volume_name': 'volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01182ee-c878-476f-838e-d0953760dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01182ee-c878-476f-838e-d0953760dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2389d1-8064-4d08-b6b0-a4707c8d50e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:31 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506', 'volume_size': 1} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-223737888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f6fa7-0f61-429b-b5c8-5ea28a6a4506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='997c467dec554c419d6426b1a8ae16f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:01:31Z,use_quota=True,user_id='18f3cd7f35ef48fe8fe346ec71b90725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Creating volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:01:31 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:01:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:31 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 1073741824 Sep 28 18:01:31 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:32 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 1073741824" returned: 0 in 1.159s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:32 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 Sep 28 18:01:32 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:33 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" returned: 0 in 0.951s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] <== create_volume: return (2292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2389d1-8064-4d08-b6b0-a4707c8d50e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c2f568-64c5-44ed-9590-87bbf78c89c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:01:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Volume volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 (921f6fa7-0f61-429b-b5c8-5ea28a6a4506): created successfully Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c2f568-64c5-44ed-9590-87bbf78c89c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:01:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Flow 'volume_create_manager' (10974203-457b-4811-a369-268cc6030dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:01:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a0cec088-b33b-4669-b33a-7d6eaf6547d9 tempest-SnapshotsActionsTest-1073038735 None] Created volume successfully. Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Creating offline snapshot c3689daf-6191-4edc-a97d-a2bce4a963d0 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a643d-87ca-4811-add1-eb1085cab3fe]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:35 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 Sep 28 18:01:35 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:35 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" returned: 0 in 0.747s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:35 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 1G Sep 28 18:01:35 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:36 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 1G" returned: 0 in 0.583s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:36 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:36 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:36 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.415s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:36 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 is being set with open permissions: ugo+rw Sep 28 18:01:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:36 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:36 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:37 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.463s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:37 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info Sep 28 18:01:37 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info" returned: 0 in 0.777s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:38 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info is being set with open permissions: ugo+rw Sep 28 18:01:38 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:38 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info Sep 28 18:01:38 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:38 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.info" returned: 0 in 0.318s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.535s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3d058329-eccd-4337-ab36-a4167a16c146 tempest-SnapshotsActionsTest-1073038735 None] Create snapshot completed successfully Sep 28 18:01:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Creating offline snapshot bb19a36a-880c-48d8-9d8e-ad19bce8dd89 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:01:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5fda08-0351-4021-9582-9cd85c752faa]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:40 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:40 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:41 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.698s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:41 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 1G Sep 28 18:01:41 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:42 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 1G" returned: 0 in 0.859s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:42 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 Sep 28 18:01:42 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:42 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89" returned: 0 in 0.607s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:42 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 is being set with open permissions: ugo+rw Sep 28 18:01:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:42 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 Sep 28 18:01:42 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:43 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89" returned: 0 in 0.385s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.766s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7106f520-9cad-4cb6-afe5-a40dab9907b9 tempest-SnapshotsActionsTest-1073038735 None] Create snapshot completed successfully Sep 28 18:01:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-bb19a36a-880c-48d8-9d8e-ad19bce8dd89-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-bb19a36a-880c-48d8-9d8e-ad19bce8dd89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-bb19a36a-880c-48d8-9d8e-ad19bce8dd89" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-bb19a36a-880c-48d8-9d8e-ad19bce8dd89" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Deleting offline snapshot bb19a36a-880c-48d8-9d8e-ad19bce8dd89 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] snapshot_file for this snap is: volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[166515e8-d0e2-41e8-99b3-654e6400aa7a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:44 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 Sep 28 18:01:44 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:44 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89" returned: 0 in 0.454s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae8349-cbb9-43f0-9e24-f9397fc7c40d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:44 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:44 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:45 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:45 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 Sep 28 18:01:45 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:45 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89" returned: 0 in 0.449s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:45 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89 Sep 28 18:01:45 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:45 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.bb19a36a-880c-48d8-9d8e-ad19bce8dd89" returned: 0 in 0.296s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-bb19a36a-880c-48d8-9d8e-ad19bce8dd89" released by "_delete_snapshot" :: held 1.816s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" released by "delete_snapshot" :: held 1.861s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:45 devstack cinder-volume[87096]: WARNING cinder.quota [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:01:45 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Created reservations ['7caa2fff-9c1f-48e4-85e1-4dfef2fffb2f', '29e54147-c4d1-4614-b45a-f2b9b2716956', '0b2fd040-3d7f-4e84-b588-338ffba5cb77', '960f2117-0eff-4a89-a1ec-ece1ecd8375c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Delete snapshot completed successfully. Sep 28 18:01:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b15ec73b-683b-419a-b813-c1b6cc4daa05 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-bb19a36a-880c-48d8-9d8e-ad19bce8dd89-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Creating offline snapshot 2087736d-a5fe-4233-ac5c-cf936689bc68 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:01:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e7eb1e-0434-4ff0-92d3-7488b36991b5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:46 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:46 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:47 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.433s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:47 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 1G Sep 28 18:01:47 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:47 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 1G" returned: 0 in 0.480s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:47 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 Sep 28 18:01:47 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:47 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68" returned: 0 in 0.359s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:47 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 is being set with open permissions: ugo+rw Sep 28 18:01:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:47 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 Sep 28 18:01:47 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:48 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68" returned: 0 in 0.267s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.702s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e89c18db-d60f-4ac9-9c2e-05519d7d004b tempest-SnapshotsActionsTest-1073038735 None] Create snapshot completed successfully Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-2087736d-a5fe-4233-ac5c-cf936689bc68-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-2087736d-a5fe-4233-ac5c-cf936689bc68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-2087736d-a5fe-4233-ac5c-cf936689bc68" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-2087736d-a5fe-4233-ac5c-cf936689bc68" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Deleting offline snapshot 2087736d-a5fe-4233-ac5c-cf936689bc68 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] snapshot_file for this snap is: volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a18f5-5a7c-46dd-9172-e1e8cc0ee529]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:48 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 Sep 28 18:01:48 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:49 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68" returned: 0 in 0.431s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f4a80-0a9d-494e-96a4-3eb9b0328601]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:49 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:49 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:49 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.441s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:49 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 Sep 28 18:01:49 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:50 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68" returned: 0 in 0.454s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:50 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68 Sep 28 18:01:50 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:50 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.2087736d-a5fe-4233-ac5c-cf936689bc68" returned: 0 in 0.308s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-2087736d-a5fe-4233-ac5c-cf936689bc68" released by "_delete_snapshot" :: held 1.746s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" released by "delete_snapshot" :: held 1.778s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Created reservations ['e5d27977-4082-45f7-8069-915af3a50185', 'f7a3ac31-470d-4922-b896-00273ff097fb', '5632ff6a-4063-4b13-a8b8-190000ca4f66', '90d8fe1c-b50c-4995-b269-63c1cb86173f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Delete snapshot completed successfully. Sep 28 18:01:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0ec98ca2-495e-450a-80f7-b36d009bde66 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-2087736d-a5fe-4233-ac5c-cf936689bc68-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Creating offline snapshot aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c98857-6616-461b-843d-aa9a0d0549e7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:51 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:51 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:51 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.391s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:51 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 1G Sep 28 18:01:51 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:52 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 1G" returned: 0 in 0.660s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:52 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 Sep 28 18:01:52 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:52 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" returned: 0 in 0.489s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:52 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 is being set with open permissions: ugo+rw Sep 28 18:01:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:52 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 Sep 28 18:01:52 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:53 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" returned: 0 in 0.407s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c4ef2b5f-bd5a-461f-9ff2-a7f95603ac1b tempest-SnapshotsActionsTest-1073038735 None] Create snapshot completed successfully Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-aa5827a3-520d-4b30-a7d4-50f47b9cdfb6-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-aa5827a3-520d-4b30-a7d4-50f47b9cdfb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Deleting offline snapshot aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] snapshot_file for this snap is: volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92a722-3599-4b57-9790-159f352c3cfd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:54 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 Sep 28 18:01:54 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:55 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c0ff1-22c5-4acb-891f-c8d7a20d5a0d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:55 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:55 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:55 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.440s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:55 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 Sep 28 18:01:55 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:56 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" returned: 0 in 0.508s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:56 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6 Sep 28 18:01:56 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:56 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" returned: 0 in 0.310s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-aa5827a3-520d-4b30-a7d4-50f47b9cdfb6" released by "_delete_snapshot" :: held 1.895s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" released by "delete_snapshot" :: held 1.938s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Created reservations ['4bccc3ed-7eef-4e10-8ac6-097804c04ed1', '6c7c3a47-fab7-491c-905d-57a89a0a017a', 'e18778df-0ca9-47e9-a7c2-ec0bf7cf4c04', 'e8f52fd9-be57-4ebb-a574-6a6e1204384b'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:01:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Delete snapshot completed successfully. Sep 28 18:01:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dfe2c393-cdde-4e2a-a7af-6cafd6f60a69 tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-aa5827a3-520d-4b30-a7d4-50f47b9cdfb6-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Creating offline snapshot 0fc71fce-c521-4637-8c29-bad1140ba907 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[82da4285-bff7-4546-addc-6d8335b94725]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:58 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:01:58 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:58 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.505s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:01:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:58 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 1G Sep 28 18:01:58 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:59 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 1G" returned: 0 in 0.707s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:59 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 Sep 28 18:01:59 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:59 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907" returned: 0 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:59 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 is being set with open permissions: ugo+rw Sep 28 18:01:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:59 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 Sep 28 18:01:59 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:00 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907" returned: 0 in 0.338s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-138131fd-f0be-484a-871f-d64d17207b94 tempest-SnapshotsActionsTest-1073038735 None] Create snapshot completed successfully Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-0fc71fce-c521-4637-8c29-bad1140ba907-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-0fc71fce-c521-4637-8c29-bad1140ba907-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Acquiring lock "cinder-quobyte-0fc71fce-c521-4637-8c29-bad1140ba907" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-0fc71fce-c521-4637-8c29-bad1140ba907" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Deleting offline snapshot 0fc71fce-c521-4637-8c29-bad1140ba907 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] snapshot_file for this snap is: volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b02aa-ece5-4957-b64e-24b3a7cb0221]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:01 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 Sep 28 18:02:01 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:02 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907" returned: 0 in 0.424s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e0e95-1d71-46d6-8707-d2faee311d61]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c13fae6a-9edf-45aa-beb9-68e825e93782 req-65f95a55-b5d5-447f-86f9-e686414dd03e tempest-AttachVolumeNegativeTest-1944563036 None] Terminate volume connection completed successfully. Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c13fae6a-9edf-45aa-beb9-68e825e93782 req-65f95a55-b5d5-447f-86f9-e686414dd03e tempest-AttachVolumeNegativeTest-1944563036 None] Deleting attachment 6c033ed0-3ad5-42af-b928-a515a5f0a239. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:02:02 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:02:02 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:02 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.510s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:02 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 Sep 28 18:02:02 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:03 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907" returned: 0 in 0.556s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:03 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907 Sep 28 18:02:03 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:03 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.0fc71fce-c521-4637-8c29-bad1140ba907" returned: 0 in 0.440s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-0fc71fce-c521-4637-8c29-bad1140ba907" released by "_delete_snapshot" :: held 2.168s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" released by "delete_snapshot" :: held 2.208s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:03 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Created reservations ['4ab73a61-f48e-4e06-b1a9-95ecae088847', 'adf3636a-987c-4cf4-88a9-7546f7ff66ab', 'b880ccf6-fd36-467a-af16-4ef82eca224e', '4b9cbf74-81d2-48c7-b0c5-c41a3e68057d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Delete snapshot completed successfully. Sep 28 18:02:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-562b4b73-e37b-42c8-9960-3208fb89396f tempest-SnapshotsActionsTest-748919919 None] Lock "cinder-0fc71fce-c521-4637-8c29-bad1140ba907-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "cinder-c3689daf-6191-4edc-a97d-a2bce4a963d0-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-c3689daf-6191-4edc-a97d-a2bce4a963d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "cinder-quobyte-c3689daf-6191-4edc-a97d-a2bce4a963d0" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-quobyte-c3689daf-6191-4edc-a97d-a2bce4a963d0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Deleting offline snapshot c3689daf-6191-4edc-a97d-a2bce4a963d0 of volume 921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] snapshot_file for this snap is: volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc9172c-4070-477c-bc1f-ccc88adfd00e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:05 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:02:05 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:05 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d2d92a-9bd4-4689-96f5-6825d02a261b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:06 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 Sep 28 18:02:06 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:06 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" returned: 0 in 0.557s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:06 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:02:06 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:07 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.637s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:07 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0 Sep 28 18:02:07 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-35cc49e8-f4af-406f-92c9-c56c9cd9d1e5 req-f3105cc4-bc14-425d-935e-db03db5f59b4 tempest-AttachVolumeTestJSON-1550402496 None] Terminate volume connection completed successfully. Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-35cc49e8-f4af-406f-92c9-c56c9cd9d1e5 req-f3105cc4-bc14-425d-935e-db03db5f59b4 tempest-AttachVolumeTestJSON-1550402496 None] Deleting attachment 00df39d7-d708-47a8-a79d-561f70191937. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:02:07 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506.c3689daf-6191-4edc-a97d-a2bce4a963d0" returned: 0 in 0.522s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-quobyte-c3689daf-6191-4edc-a97d-a2bce4a963d0" released by "_delete_snapshot" :: held 2.365s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" released by "delete_snapshot" :: held 2.407s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Created reservations ['71ef60c0-87ac-46ab-845d-658bb94dad1a', '952a348c-8cc0-4a83-bc05-a460e9b67677', 'b42804ab-4a49-4843-87ca-9a12b59e37a3', '4f25cfe4-2d4d-4b38-aa21-fdd949eaffbf'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Delete snapshot completed successfully. Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab517e03-b5d1-4e15-8b17-d63562022428 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-c3689daf-6191-4edc-a97d-a2bce4a963d0-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "cinder-921f6fa7-0f61-429b-b5c8-5ea28a6a4506-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-921f6fa7-0f61-429b-b5c8-5ea28a6a4506-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d445f44-09a8-409f-b250-eea6ac13f651]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:09 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 Sep 28 18:02:09 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:09 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" returned: 0 in 0.534s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:09 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506 Sep 28 18:02:09 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:09 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" returned: 0 in 0.342s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-quobyte-921f6fa7-0f61-429b-b5c8-5ea28a6a4506" released by "delete_volume" :: held 0.987s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:09 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Created reservations ['aae3e11e-e510-4a47-965d-ebbfdffaa3c1', '8671a7fd-0245-4a03-8c7f-950e24bb4083', '7522cae3-bc27-416c-94dc-6c1c3dadecf1', '68b123fc-9f8a-4388-bb82-bf79617d0847'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-73b5f7c6-68a9-4037-8b90-94237ae01a38 req-bbfa41cf-1c3d-4d87-9fa7-2d8bb752035e tempest-TaggedAttachmentsTest-1630347113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-73b5f7c6-68a9-4037-8b90-94237ae01a38 req-bbfa41cf-1c3d-4d87-9fa7-2d8bb752035e tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:10 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:02:10 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-73b5f7c6-68a9-4037-8b90-94237ae01a38 req-bbfa41cf-1c3d-4d87-9fa7-2d8bb752035e tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-73b5f7c6-68a9-4037-8b90-94237ae01a38 req-bbfa41cf-1c3d-4d87-9fa7-2d8bb752035e tempest-TaggedAttachmentsTest-1630347113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a370f836-1e9e-48d8-8375-db239b51fe55', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:02:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-73b5f7c6-68a9-4037-8b90-94237ae01a38 req-bbfa41cf-1c3d-4d87-9fa7-2d8bb752035e tempest-TaggedAttachmentsTest-1630347113 None] attachment_update completed successfully. Sep 28 18:02:10 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.292s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Deleted volume successfully. Sep 28 18:02:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6274e8d8-ae46-40e0-8d41-a6233549e9f0 tempest-SnapshotsActionsTest-1073038735 None] Lock "cinder-921f6fa7-0f61-429b-b5c8-5ea28a6a4506-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-9ff0b14b-abed-4932-a2e3-5d5cc2878f2a req-867a8627-9134-4ca6-924d-af7ac8171385 tempest-TaggedAttachmentsTest-1630347113 None] Terminate volume connection completed successfully. Sep 28 18:02:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-9ff0b14b-abed-4932-a2e3-5d5cc2878f2a req-867a8627-9134-4ca6-924d-af7ac8171385 tempest-TaggedAttachmentsTest-1630347113 None] Deleting attachment a370f836-1e9e-48d8-8375-db239b51fe55. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:23 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:02:23 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=55,cinder:INSERT=15,cinder:UPDATE=40,cinder:DELETE=5 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=53,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:24 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.729s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 8 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:02:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:02:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Acquiring lock "cinder-ed3ea435-35fc-4c1c-aac1-d94639cb2a34-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Lock "cinder-ed3ea435-35fc-4c1c-aac1-d94639cb2a34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Acquiring lock "cinder-quobyte-ed3ea435-35fc-4c1c-aac1-d94639cb2a34" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:02:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Lock "cinder-quobyte-ed3ea435-35fc-4c1c-aac1-d94639cb2a34" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:02:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0eef5-4f0e-4f83-aa39-72d1e0f2e438]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:02:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:31 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 Sep 28 18:02:31 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:32 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34" returned: 0 in 0.552s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:32 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34 Sep 28 18:02:32 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:32 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ed3ea435-35fc-4c1c-aac1-d94639cb2a34" returned: 0 in 0.317s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Lock "cinder-quobyte-ed3ea435-35fc-4c1c-aac1-d94639cb2a34" released by "delete_volume" :: held 0.957s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Created reservations ['5ec25715-c85e-4a4d-8c41-ebd572236a8d', 'f5c403bd-17af-46a9-bf98-654f6cb6a13e', '3ff6a066-a7b0-45a7-adc6-49a61226b0ff', '292f34f0-ca8b-4592-b750-26e0ad0f8da0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:32 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:02:32 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:32 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:32 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Deleted volume successfully. Sep 28 18:02:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bfa81076-1230-42c3-9e90-c08d38db11ca tempest-TaggedAttachmentsTest-1630347113 None] Lock "cinder-ed3ea435-35fc-4c1c-aac1-d94639cb2a34-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:02:42 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=3 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:43 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Flow 'volume_create_manager' (9fbd48b5-ca83-48ec-8259-0b6335c33a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f52ba6-b9d5-4e50-939a-b204d226cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f52ba6-b9d5-4e50-939a-b204d226cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-99040596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80848bd-8df8-41cc-bb23-26309759b217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419375d78844e88b478e0b98052fb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:52Z,use_quota=True,user_id='9b7cc989f312490d8a5632af11d9d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d49efe-3f32-4f1f-aa74-0250d0685131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d49efe-3f32-4f1f-aa74-0250d0685131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76598753-3f58-4a15-8c59-de7f3f35d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76598753-3f58-4a15-8c59-de7f3f35d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80848bd-8df8-41cc-bb23-26309759b217', 'volume_name': 'volume-b80848bd-8df8-41cc-bb23-26309759b217', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d7a9db-1210-4cf1-a64c-4da8ac31dc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d7a9db-1210-4cf1-a64c-4da8ac31dc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fd2cee-e814-48ad-a9a4-c637d6e9acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Volume b80848bd-8df8-41cc-bb23-26309759b217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80848bd-8df8-41cc-bb23-26309759b217', 'volume_size': 1} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-99040596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80848bd-8df8-41cc-bb23-26309759b217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419375d78844e88b478e0b98052fb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:52Z,use_quota=True,user_id='9b7cc989f312490d8a5632af11d9d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Creating volume b80848bd-8df8-41cc-bb23-26309759b217 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:02:51 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:02:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:51 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 1073741824 Sep 28 18:02:51 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:52 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 1073741824" returned: 0 in 0.772s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:52 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 Sep 28 18:02:52 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:53 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217" returned: 0 in 0.342s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fd2cee-e814-48ad-a9a4-c637d6e9acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80848bd-8df8-41cc-bb23-26309759b217', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97f1e99-3273-4305-8eb9-8aaa9ed1a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Volume volume-b80848bd-8df8-41cc-bb23-26309759b217 (b80848bd-8df8-41cc-bb23-26309759b217): created successfully Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97f1e99-3273-4305-8eb9-8aaa9ed1a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Flow 'volume_create_manager' (9fbd48b5-ca83-48ec-8259-0b6335c33a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-072b0abf-2093-4f25-9614-b707dd775bd3 tempest-AttachVolumeNegativeTest-1944563036 None] Created volume successfully. Sep 28 18:02:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-61c9a516-4013-41e5-87e8-9502bbb453f7 req-60c0f2bf-9db7-4b08-9f61-3968ef04e364 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-61c9a516-4013-41e5-87e8-9502bbb453f7 req-60c0f2bf-9db7-4b08-9f61-3968ef04e364 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-61c9a516-4013-41e5-87e8-9502bbb453f7 req-60c0f2bf-9db7-4b08-9f61-3968ef04e364 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-61c9a516-4013-41e5-87e8-9502bbb453f7 req-60c0f2bf-9db7-4b08-9f61-3968ef04e364 tempest-AttachVolumeNegativeTest-1944563036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-b80848bd-8df8-41cc-bb23-26309759b217', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0f91891-6bfb-4f83-b7af-b594f0128cc3', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:02:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-61c9a516-4013-41e5-87e8-9502bbb453f7 req-60c0f2bf-9db7-4b08-9f61-3968ef04e364 tempest-AttachVolumeNegativeTest-1944563036 None] attachment_update completed successfully. Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Flow 'volume_create_manager' (7082d4da-cac1-4e89-98ec-b410324a5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354ee093-dd9e-4edf-96b0-9a40267fb0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354ee093-dd9e-4edf-96b0-9a40267fb0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1918840118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884540fe-c032-48e9-8233-2c72c0f6d5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17c4f3fa8a748fb9e09aed759be2d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:59Z,use_quota=True,user_id='73115b0caa654d4db131fc1b280c084d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9624799-ce99-4eaa-8979-92404162185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9624799-ce99-4eaa-8979-92404162185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56345f-d380-4e7c-960e-bf6d1109b90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d56345f-d380-4e7c-960e-bf6d1109b90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884540fe-c032-48e9-8233-2c72c0f6d5f5', 'volume_name': 'volume-884540fe-c032-48e9-8233-2c72c0f6d5f5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097d60c6-e58b-4a18-9905-7d9e13b62c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097d60c6-e58b-4a18-9905-7d9e13b62c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c15014-a761-44a0-8b14-75fa6548613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:02:58 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Volume 884540fe-c032-48e9-8233-2c72c0f6d5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884540fe-c032-48e9-8233-2c72c0f6d5f5', 'volume_size': 1} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1918840118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884540fe-c032-48e9-8233-2c72c0f6d5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c17c4f3fa8a748fb9e09aed759be2d78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:02:59Z,use_quota=True,user_id='73115b0caa654d4db131fc1b280c084d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Creating volume 884540fe-c032-48e9-8233-2c72c0f6d5f5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:02:58 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:02:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:58 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 1073741824 Sep 28 18:02:58 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-1e6de661-4392-4705-bed3-c22356790e00 req-b1fc50b2-d6f2-4b08-9fd0-305e9b70cc54 tempest-AttachVolumeNegativeTest-1944563036 None] Terminate volume connection completed successfully. Sep 28 18:02:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-1e6de661-4392-4705-bed3-c22356790e00 req-b1fc50b2-d6f2-4b08-9fd0-305e9b70cc54 tempest-AttachVolumeNegativeTest-1944563036 None] Deleting attachment b0f91891-6bfb-4f83-b7af-b594f0128cc3. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:03:00 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 1073741824" returned: 0 in 1.126s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:00 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 Sep 28 18:03:00 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:00 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5" returned: 0 in 0.592s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c15014-a761-44a0-8b14-75fa6548613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884540fe-c032-48e9-8233-2c72c0f6d5f5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd115620-81a0-49f8-bd03-7dcb9f2cb4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:00 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Volume volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 (884540fe-c032-48e9-8233-2c72c0f6d5f5): created successfully Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd115620-81a0-49f8-bd03-7dcb9f2cb4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Flow 'volume_create_manager' (7082d4da-cac1-4e89-98ec-b410324a5624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0bb4e416-41fe-4ed7-93f3-49611502380a tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Created volume successfully. Sep 28 18:03:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Acquiring lock "cinder-884540fe-c032-48e9-8233-2c72c0f6d5f5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "cinder-884540fe-c032-48e9-8233-2c72c0f6d5f5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Acquiring lock "cinder-quobyte-884540fe-c032-48e9-8233-2c72c0f6d5f5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "cinder-quobyte-884540fe-c032-48e9-8233-2c72c0f6d5f5" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dcf844-0948-474e-b0ca-4bb80ee4fafb]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:03 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 Sep 28 18:03:03 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:04 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5" returned: 0 in 0.784s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:04 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5 Sep 28 18:03:04 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:04 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-884540fe-c032-48e9-8233-2c72c0f6d5f5" returned: 0 in 0.568s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "cinder-quobyte-884540fe-c032-48e9-8233-2c72c0f6d5f5" released by "delete_volume" :: held 1.454s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:04 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Created reservations ['b19c34f3-9ec2-4df6-a033-4e72dbcf910f', '72e29c5c-ae99-4be9-a5fc-09ca5895c137', '691c51f9-84db-4333-bc12-9422f1d4652c', '6536d853-2c03-40d2-ab19-f32c37db0263'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:05 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:03:05 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:05 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.395s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Deleted volume successfully. Sep 28 18:03:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b65ef743-d872-4b8c-b7c7-26e3d286221e tempest-VolumeQuotasNegativeTestJSON-1619841972 None] Lock "cinder-884540fe-c032-48e9-8233-2c72c0f6d5f5-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:15 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:15 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:23 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:03:23 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:24 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.499s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 8 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:03:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Flow 'volume_create_manager' (684ec188-d172-4481-9921-7c07ad147b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4e9160-9cf7-4e0b-b3d8-70d358ef75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4e9160-9cf7-4e0b-b3d8-70d358ef75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-396391732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7551641d-287f-4933-a537-a513c16cdcd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8b8250bb8b4f72a366615b92e299bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:30Z,use_quota=True,user_id='63d9654fb68e4a49bf11838925c8dfbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd4a09b-f5f6-4ff6-b0ed-95f93bca9743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd4a09b-f5f6-4ff6-b0ed-95f93bca9743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a39ebb3-d146-486f-901e-cad358463400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a39ebb3-d146-486f-901e-cad358463400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7551641d-287f-4933-a537-a513c16cdcd3', 'volume_name': 'volume-7551641d-287f-4933-a537-a513c16cdcd3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b9cb32-66ef-4a87-ac22-04707e7ab09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b9cb32-66ef-4a87-ac22-04707e7ab09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d480a-d500-457c-b0d4-ccb38c0a39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:30 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Volume 7551641d-287f-4933-a537-a513c16cdcd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7551641d-287f-4933-a537-a513c16cdcd3', 'volume_size': 1} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-396391732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7551641d-287f-4933-a537-a513c16cdcd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8b8250bb8b4f72a366615b92e299bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:30Z,use_quota=True,user_id='63d9654fb68e4a49bf11838925c8dfbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Creating volume 7551641d-287f-4933-a537-a513c16cdcd3 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:30 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:30 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 1073741824 Sep 28 18:03:30 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Flow 'volume_create_manager' (a7078080-b6fd-4d82-a0f4-03f00892d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e64c6-dffa-44f3-845d-7ef014793f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e64c6-dffa-44f3-845d-7ef014793f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1515429369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e38b2f-516b-4cd6-948f-07bd98ddb1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a8dd8b6c0a4b7a8c57866f1ca55539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:31Z,use_quota=True,user_id='7211a2bdaf544dbfb0ec984d4f376b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b3578d-9e30-4996-be44-6e8c79569ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b3578d-9e30-4996-be44-6e8c79569ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e01c42-f903-4094-8753-d3a8627d188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:03:31 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 1073741824" returned: 0 in 1.060s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:32 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 Sep 28 18:03:32 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3" returned: 0 in 0.899s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:32 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d480a-d500-457c-b0d4-ccb38c0a39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7551641d-287f-4933-a537-a513c16cdcd3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3784c348-cf66-4c49-803e-cd79f2727032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Volume volume-7551641d-287f-4933-a537-a513c16cdcd3 (7551641d-287f-4933-a537-a513c16cdcd3): created successfully Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3784c348-cf66-4c49-803e-cd79f2727032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Flow 'volume_create_manager' (684ec188-d172-4481-9921-7c07ad147b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0e39bd48-f42d-49b1-bd52-5b5ecbd5d695 tempest-AttachVolumeTestJSON-1550402496 None] Created volume successfully. Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e01c42-f903-4094-8753-d3a8627d188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58e38b2f-516b-4cd6-948f-07bd98ddb1b2', 'volume_name': 'volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70405d2-d08d-4842-bac5-c51dceda5dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70405d2-d08d-4842-bac5-c51dceda5dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5106d3a7-0d67-4c2b-9ded-096dfe68ee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Volume 58e38b2f-516b-4cd6-948f-07bd98ddb1b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:03:33 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Trying to clone 58e38b2f-516b-4cd6-948f-07bd98ddb1b2 from image fadc8935-e87d-4b36-9885-050bf1046672 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:03:34 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:03:34 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:03:34 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccaac10-796c-41cc-8de2-e6d3ec7ce443]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:34 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD Sep 28 18:03:34 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:35 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 is fetched for user 7211a2bdaf544dbfb0ec984d4f376b39. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[12524be3-9fb2-4be3-9cec-ced510301fd4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:35 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD Sep 28 18:03:35 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:35 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1515429369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e38b2f-516b-4cd6-948f-07bd98ddb1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a8dd8b6c0a4b7a8c57866f1ca55539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:31Z,use_quota=True,user_id='7211a2bdaf544dbfb0ec984d4f376b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Creating volume 58e38b2f-516b-4cd6-948f-07bd98ddb1b2 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:35 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:36 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 1073741824 Sep 28 18:03:36 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-481378f1-36cb-4313-8174-4b01c37d4b2d req-639c52c4-20c9-426b-80fc-9d917644a13a tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:36 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 1073741824" returned: 0 in 0.673s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:36 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 Sep 28 18:03:36 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:36 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" returned: 0 in 0.271s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-481378f1-36cb-4313-8174-4b01c37d4b2d req-639c52c4-20c9-426b-80fc-9d917644a13a tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.894s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-481378f1-36cb-4313-8174-4b01c37d4b2d req-639c52c4-20c9-426b-80fc-9d917644a13a tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Attempting download of fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume 58e38b2f-516b-4cd6-948f-07bd98ddb1b2. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-481378f1-36cb-4313-8174-4b01c37d4b2d req-639c52c4-20c9-426b-80fc-9d917644a13a tempest-AttachVolumeTestJSON-1550402496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-7551641d-287f-4933-a537-a513c16cdcd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6819dfc3-bb5e-4489-8ddb-04bc543e174e', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[53361e65-a2a3-44f8-a044-b534fab03c46]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-481378f1-36cb-4313-8174-4b01c37d4b2d req-639c52c4-20c9-426b-80fc-9d917644a13a tempest-AttachVolumeTestJSON-1550402496 None] attachment_update completed successfully. Sep 28 18:03:37 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv Sep 28 18:03:37 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:37 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv" returned: 0 in 0.544s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:37 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv Sep 28 18:03:37 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:38 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv" returned: 1 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oikybshv' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4023d-e245-4e92-b4b7-079e6b685e6e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:38 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD Sep 28 18:03:38 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:38 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] fadc8935-e87d-4b36-9885-050bf1046672 was qcow2, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:03:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:38 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 Sep 28 18:03:38 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Flow 'volume_create_manager' (5c91836b-5e66-4474-a3f2-e38f17c3c8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5999a663-c9a4-4261-bfad-9e6305901483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5999a663-c9a4-4261-bfad-9e6305901483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1861071442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8b8250bb8b4f72a366615b92e299bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:40Z,use_quota=True,user_id='63d9654fb68e4a49bf11838925c8dfbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85041244-042f-485d-a805-345d656edab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85041244-042f-485d-a805-345d656edab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d799658b-7bef-40d8-96e9-23045c009a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d799658b-7bef-40d8-96e9-23045c009a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b', 'volume_name': 'volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b34493-4ebd-447c-890a-6817f08225e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b34493-4ebd-447c-890a-6817f08225e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c06104-a227-457b-b279-19406296a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Volume c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b', 'volume_size': 1} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1861071442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8b8250bb8b4f72a366615b92e299bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:40Z,use_quota=True,user_id='63d9654fb68e4a49bf11838925c8dfbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Creating volume c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:39 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:39 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b 1073741824 Sep 28 18:03:40 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:40 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b 1073741824" returned: 0 in 0.644s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:40 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b Sep 28 18:03:40 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:40 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c06104-a227-457b-b279-19406296a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a328015c-1815-4117-ab87-5f88868c9f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Volume volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b (c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b): created successfully Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a328015c-1815-4117-ab87-5f88868c9f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Flow 'volume_create_manager' (5c91836b-5e66-4474-a3f2-e38f17c3c8d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-58e04bf8-7b88-4542-a560-d5d180dae8ff tempest-AttachVolumeTestJSON-1550402496 None] Created volume successfully. Sep 28 18:03:41 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" returned: 0 in 2.508s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_a2q8yczwdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:03:41 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Converted 112.00 MB image at 44.62 MB/s Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:41 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 1G Sep 28 18:03:41 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:41 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 1G" returned: 0 in 0.368s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Downloaded image fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume 58e38b2f-516b-4cd6-948f-07bd98ddb1b2 successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 for user 7211a2bdaf544dbfb0ec984d4f376b39 is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Marking volume 58e38b2f-516b-4cd6-948f-07bd98ddb1b2 as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Copying metadata from image fadc8935-e87d-4b36-9885-050bf1046672 to 58e38b2f-516b-4cd6-948f-07bd98ddb1b2. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Creating volume glance metadata for volume 58e38b2f-516b-4cd6-948f-07bd98ddb1b2 backed by image fadc8935-e87d-4b36-9885-050bf1046672 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5106d3a7-0d67-4c2b-9ded-096dfe68ee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd3f04c-6426-43ca-8ce8-ba4200d06b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Volume volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 (58e38b2f-516b-4cd6-948f-07bd98ddb1b2): created successfully Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd3f04c-6426-43ca-8ce8-ba4200d06b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Flow 'volume_create_manager' (a7078080-b6fd-4d82-a0f4-03f00892d600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-85998eef-2ea5-4e2e-9106-58bb8a231b97 tempest-VolumesImageMetadata-1636941707 None] Created volume successfully. Sep 28 18:03:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c9d02765-c2dd-4da2-9e0a-3cd4dba1c109 req-71edc4ec-1198-454e-a2ea-f09aeb53905e tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c9d02765-c2dd-4da2-9e0a-3cd4dba1c109 req-71edc4ec-1198-454e-a2ea-f09aeb53905e tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c9d02765-c2dd-4da2-9e0a-3cd4dba1c109 req-71edc4ec-1198-454e-a2ea-f09aeb53905e tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c9d02765-c2dd-4da2-9e0a-3cd4dba1c109 req-71edc4ec-1198-454e-a2ea-f09aeb53905e tempest-AttachVolumeTestJSON-1550402496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a58b6b5f-9fda-40f5-9b1f-0d8f93b964c6', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:03:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Acquiring lock "cinder-58e38b2f-516b-4cd6-948f-07bd98ddb1b2-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Lock "cinder-58e38b2f-516b-4cd6-948f-07bd98ddb1b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c9d02765-c2dd-4da2-9e0a-3cd4dba1c109 req-71edc4ec-1198-454e-a2ea-f09aeb53905e tempest-AttachVolumeTestJSON-1550402496 None] attachment_update completed successfully. Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Acquiring lock "cinder-quobyte-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Lock "cinder-quobyte-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3b3a0b-b8e7-4e16-8aba-0b6e0d083113]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:43 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 Sep 28 18:03:43 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:43 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:43 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2 Sep 28 18:03:43 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:43 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" returned: 0 in 0.320s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Lock "cinder-quobyte-58e38b2f-516b-4cd6-948f-07bd98ddb1b2" released by "delete_volume" :: held 0.860s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:43 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Created reservations ['46422456-e687-4152-a636-c3fed9398798', '322b7776-3c91-49cf-8f14-526df4465ce9', '563de336-b6d5-4802-b829-ee3b318e767e', '64d87c6f-c4af-48ff-86e4-c40cc4143776'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:44 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:03:44 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:44 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.322s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Deleted volume successfully. Sep 28 18:03:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c320f88b-870e-49fc-b8f5-3f4860944d83 tempest-VolumesImageMetadata-1636941707 None] Lock "cinder-58e38b2f-516b-4cd6-948f-07bd98ddb1b2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-fa3349f0-3f7a-4da7-aef5-59a89adac97d req-f8827e88-75df-402e-b015-51a8fb2aea60 tempest-AttachVolumeTestJSON-1550402496 None] Terminate volume connection completed successfully. Sep 28 18:03:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-fa3349f0-3f7a-4da7-aef5-59a89adac97d req-f8827e88-75df-402e-b015-51a8fb2aea60 tempest-AttachVolumeTestJSON-1550402496 None] Deleting attachment 6819dfc3-bb5e-4489-8ddb-04bc543e174e. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:03:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-a0ddc5fe-f9ef-492b-8573-88a30613f655 req-8b91a38c-d339-4dce-a647-91a6808c3d47 tempest-AttachVolumeTestJSON-1550402496 None] Terminate volume connection completed successfully. Sep 28 18:03:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-a0ddc5fe-f9ef-492b-8573-88a30613f655 req-8b91a38c-d339-4dce-a647-91a6808c3d47 tempest-AttachVolumeTestJSON-1550402496 None] Deleting attachment a58b6b5f-9fda-40f5-9b1f-0d8f93b964c6. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Flow 'volume_create_manager' (bca7dce5-a61b-4650-92de-2a3f785e5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b921e9-c785-4ffd-898c-327617816850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b921e9-c785-4ffd-898c-327617816850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1277042008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6207e2e4-66b3-46de-83b5-fe7cfefb667a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4873ea4029546ecbf970615b859dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:51Z,use_quota=True,user_id='906e9003b3bd4d4ea82e88e93e9091e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee31523c-6054-4973-9449-d3bee0de5c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee31523c-6054-4973-9449-d3bee0de5c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7b815d-bb07-4f6b-ab17-bb6d8945680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7b815d-bb07-4f6b-ab17-bb6d8945680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6207e2e4-66b3-46de-83b5-fe7cfefb667a', 'volume_name': 'volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bed1bb-7ac6-45a7-b96d-3cb9e70140b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bed1bb-7ac6-45a7-b96d-3cb9e70140b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdedaf6-0d5b-46d2-bc0d-c6e6a3f8fa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:50 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Volume 6207e2e4-66b3-46de-83b5-fe7cfefb667a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a', 'volume_size': 1} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1277042008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6207e2e4-66b3-46de-83b5-fe7cfefb667a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4873ea4029546ecbf970615b859dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:51Z,use_quota=True,user_id='906e9003b3bd4d4ea82e88e93e9091e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Creating volume 6207e2e4-66b3-46de-83b5-fe7cfefb667a {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:50 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:50 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a 1073741824 Sep 28 18:03:50 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:51 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a 1073741824" returned: 0 in 0.673s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:51 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a Sep 28 18:03:51 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:51 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a" returned: 0 in 0.346s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdedaf6-0d5b-46d2-bc0d-c6e6a3f8fa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6546f3-b5d2-4ab4-9944-4ab452644395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Volume volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a (6207e2e4-66b3-46de-83b5-fe7cfefb667a): created successfully Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6546f3-b5d2-4ab4-9944-4ab452644395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Flow 'volume_create_manager' (bca7dce5-a61b-4650-92de-2a3f785e5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-23db6089-e771-4259-abcf-614536ea34ce tempest-VolumesTransfersTest-162710219 None] Created volume successfully. Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Flow 'volume_create_manager' (2e996d51-349b-4bcb-8ee7-ad62fbb99dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3523ca6c-ec7b-4542-a6f0-1f92e02a80a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3523ca6c-ec7b-4542-a6f0-1f92e02a80a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-845699228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553eacd7-97d7-4e85-a3ed-580f4e65e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419375d78844e88b478e0b98052fb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:54Z,use_quota=True,user_id='9b7cc989f312490d8a5632af11d9d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb85a2d-e4f5-4ce6-8e91-8d83945f8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb85a2d-e4f5-4ce6-8e91-8d83945f8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0e245c-1cc9-4603-b314-aa6273c2cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0e245c-1cc9-4603-b314-aa6273c2cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553eacd7-97d7-4e85-a3ed-580f4e65e57c', 'volume_name': 'volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6436a8e5-1e28-4f30-a747-3cc6ad42d6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6436a8e5-1e28-4f30-a747-3cc6ad42d6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078fc93f-1120-404a-80c7-bc71865960e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Volume 553eacd7-97d7-4e85-a3ed-580f4e65e57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c', 'volume_size': 1} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-845699228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553eacd7-97d7-4e85-a3ed-580f4e65e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b419375d78844e88b478e0b98052fb4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:54Z,use_quota=True,user_id='9b7cc989f312490d8a5632af11d9d7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Creating volume 553eacd7-97d7-4e85-a3ed-580f4e65e57c {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:53 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:53 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c 1073741824 Sep 28 18:03:53 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-95484f64-4449-49c3-a114-3718f8af0de6 tempest-VolumesTransfersTest-1127677797 None] Transfer volume completed successfully. Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "cinder-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "cinder-quobyte-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-quobyte-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:54 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c553a7a2-1d42-4ac5-8403-a7f31b8bc1bb]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c 1073741824" returned: 0 in 0.734s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:54 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c Sep 28 18:03:54 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:54 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b Sep 28 18:03:54 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Acquiring lock "cinder-6207e2e4-66b3-46de-83b5-fe7cfefb667a-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-6207e2e4-66b3-46de-83b5-fe7cfefb667a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Acquiring lock "cinder-quobyte-6207e2e4-66b3-46de-83b5-fe7cfefb667a" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-quobyte-6207e2e4-66b3-46de-83b5-fe7cfefb667a" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:55 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e43de2-0a88-4b92-81d6-8e39146e94a0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c" returned: 0 in 0.417s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078fc93f-1120-404a-80c7-bc71865960e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a898cada-515d-44fd-ae4d-878fef9c38a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Volume volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c (553eacd7-97d7-4e85-a3ed-580f4e65e57c): created successfully Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a898cada-515d-44fd-ae4d-878fef9c38a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Flow 'volume_create_manager' (2e996d51-349b-4bcb-8ee7-ad62fbb99dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:55 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b" returned: 0 in 0.633s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c51808bd-1421-4605-b5b3-a79cd7042470 tempest-AttachVolumeNegativeTest-1944563036 None] Created volume successfully. Sep 28 18:03:55 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b Sep 28 18:03:55 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:55 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a Sep 28 18:03:55 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Flow 'volume_create_manager' (c1d35f8f-0496-445c-bcf3-273e98409b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbc3fa1-c2ad-448e-af8c-d99e8f969e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbc3fa1-c2ad-448e-af8c-d99e8f969e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1452770205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d7cace-8b1c-4f76-af81-16c8f4b2d64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b7dde9549147ef8973b36707a21129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:55Z,use_quota=True,user_id='b2517dbb3b7f41a581e558035336650d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0fb87e-d2a6-4396-be62-a3acc7302e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0fb87e-d2a6-4396-be62-a3acc7302e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98231c1-b379-49a1-aea6-cf9c2b47ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98231c1-b379-49a1-aea6-cf9c2b47ed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d7cace-8b1c-4f76-af81-16c8f4b2d64d', 'volume_name': 'volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc96409-8151-4704-b45f-33373ca7f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc96409-8151-4704-b45f-33373ca7f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f68bffd-f473-4050-af64-daf8ec544e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Volume f9d7cace-8b1c-4f76-af81-16c8f4b2d64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d', 'volume_size': 1} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1452770205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d7cace-8b1c-4f76-af81-16c8f4b2d64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b7dde9549147ef8973b36707a21129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:55Z,use_quota=True,user_id='b2517dbb3b7f41a581e558035336650d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Creating volume f9d7cace-8b1c-4f76-af81-16c8f4b2d64d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:55 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:55 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d 1073741824 Sep 28 18:03:55 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:55 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b" returned: 0 in 0.413s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-quobyte-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b" released by "delete_volume" :: held 1.147s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:55 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a" returned: 0 in 0.653s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:55 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a Sep 28 18:03:55 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Created reservations ['8e25b128-7566-44c9-b243-72dc4a2f946d', '89f82fbf-caa8-4fb8-bdc3-acdc30b515b1', '429e1408-609f-4ef6-9917-78fef09819f3', '49189d5b-7fa3-4457-aec7-6b11bc08b18e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:55 devstack sudo[93451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:03:55 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6207e2e4-66b3-46de-83b5-fe7cfefb667a" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-quobyte-6207e2e4-66b3-46de-83b5-fe7cfefb667a" released by "delete_volume" :: held 1.206s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Created reservations ['cb81b5b2-2aab-4818-8ce0-b41ebaabb206', '0897d0f9-d01e-42a7-a661-7068ae8fa73d', '2fc484da-a6a8-4b29-b3df-b0ac6ce56f7c', '28c2fd06-5acc-4468-8ea9-3b9397140e2f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:56 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d 1073741824" returned: 0 in 0.933s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:56 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.533s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Deleted volume successfully. Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:56 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d Sep 28 18:03:56 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f4473d20-6077-4011-bb5b-122cdc424717 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-c7c8fcd8-13ee-4dc0-9d22-9a6bbbe8363b-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:56 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:03:56 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "cinder-7551641d-287f-4933-a537-a513c16cdcd3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-7551641d-287f-4933-a537-a513c16cdcd3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "cinder-quobyte-7551641d-287f-4933-a537-a513c16cdcd3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:57 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d" returned: 0 in 0.576s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-quobyte-7551641d-287f-4933-a537-a513c16cdcd3" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:57 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f68bffd-f473-4050-af64-daf8ec544e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2719fe-6aac-4bb7-a40d-1c9ba923958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf95c6-bc59-49aa-9cf5-2bf74e8d9c7f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.596s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Volume volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d (f9d7cace-8b1c-4f76-af81-16c8f4b2d64d): created successfully Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2719fe-6aac-4bb7-a40d-1c9ba923958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Flow 'volume_create_manager' (c1d35f8f-0496-445c-bcf3-273e98409b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Deleted volume successfully. Sep 28 18:03:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0681f5ad-26fb-499d-aba9-6224e1effee2 tempest-ServerActionsTestOtherA-297840239 None] Created volume successfully. Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4b7ba720-ea8f-4840-9b2d-a9900347c687 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-6207e2e4-66b3-46de-83b5-fe7cfefb667a-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:57 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 Sep 28 18:03:57 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-9f06dd37-782d-4c68-ab1a-a01c10b4e22a req-e078eaef-4429-44be-a6c9-e26116bff114 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-9f06dd37-782d-4c68-ab1a-a01c10b4e22a req-e078eaef-4429-44be-a6c9-e26116bff114 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-9f06dd37-782d-4c68-ab1a-a01c10b4e22a req-e078eaef-4429-44be-a6c9-e26116bff114 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-9f06dd37-782d-4c68-ab1a-a01c10b4e22a req-e078eaef-4429-44be-a6c9-e26116bff114 tempest-AttachVolumeNegativeTest-1944563036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1660eeb-5e47-45f8-90f8-ad76805389d7', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:03:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-9f06dd37-782d-4c68-ab1a-a01c10b4e22a req-e078eaef-4429-44be-a6c9-e26116bff114 tempest-AttachVolumeNegativeTest-1944563036 None] attachment_update completed successfully. Sep 28 18:03:57 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3" returned: 0 in 0.753s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:57 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3 Sep 28 18:03:57 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:58 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Flow 'volume_create_manager' (0d49c377-9cb4-4abb-b32b-3130b93bf3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b326db0-b88b-4034-9789-a37a54736637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7551641d-287f-4933-a537-a513c16cdcd3" returned: 0 in 0.460s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b326db0-b88b-4034-9789-a37a54736637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-320027788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd581bf7-5e32-4a1b-90dd-59a509315999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4873ea4029546ecbf970615b859dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:58Z,use_quota=True,user_id='906e9003b3bd4d4ea82e88e93e9091e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3c00e0-4a7e-4e01-a396-c22e5dd3fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3c00e0-4a7e-4e01-a396-c22e5dd3fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0b037e-0f73-417e-b25e-04e7d5e8617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0b037e-0f73-417e-b25e-04e7d5e8617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd581bf7-5e32-4a1b-90dd-59a509315999', 'volume_name': 'volume-dd581bf7-5e32-4a1b-90dd-59a509315999', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e71895-5b87-48c0-9129-6a2834544cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e71895-5b87-48c0-9129-6a2834544cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b719075-f243-4bc5-b27c-0c97a5ce6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:58 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Volume dd581bf7-5e32-4a1b-90dd-59a509315999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd581bf7-5e32-4a1b-90dd-59a509315999', 'volume_size': 1} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-320027788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd581bf7-5e32-4a1b-90dd-59a509315999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4873ea4029546ecbf970615b859dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:58Z,use_quota=True,user_id='906e9003b3bd4d4ea82e88e93e9091e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Creating volume dd581bf7-5e32-4a1b-90dd-59a509315999 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:58 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-quobyte-7551641d-287f-4933-a537-a513c16cdcd3" released by "delete_volume" :: held 1.392s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:58 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 1073741824 Sep 28 18:03:58 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Created reservations ['e1d3459d-32a0-41c7-8212-3433cfa2f9fd', '86a6c0bd-9363-438c-bca7-33d4b3eca0bf', 'c73bdcdb-c490-48d4-b2d7-b2204e0ef314', '98084ff1-7f69-4365-9dc7-9393f134797f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:58 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:03:58 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:59 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.406s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Deleted volume successfully. Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e32ce89-e0b9-4c80-b9fe-e6d7cde70458 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-7551641d-287f-4933-a537-a513c16cdcd3-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:59 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 1073741824" returned: 0 in 0.801s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:59 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 Sep 28 18:03:59 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "cinder-4e189ac5-d5d1-4274-814d-f725c6db4e87-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-4e189ac5-d5d1-4274-814d-f725c6db4e87-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "cinder-quobyte-4e189ac5-d5d1-4274-814d-f725c6db4e87" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-quobyte-4e189ac5-d5d1-4274-814d-f725c6db4e87" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a6636-cf40-437d-bd46-89c3a49a92ca]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:59 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999" returned: 0 in 0.460s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b719075-f243-4bc5-b27c-0c97a5ce6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd581bf7-5e32-4a1b-90dd-59a509315999', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935e6c4f-cc52-45f1-af8c-5eed7dcf89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:59 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Volume volume-dd581bf7-5e32-4a1b-90dd-59a509315999 (dd581bf7-5e32-4a1b-90dd-59a509315999): created successfully Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935e6c4f-cc52-45f1-af8c-5eed7dcf89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Flow 'volume_create_manager' (0d49c377-9cb4-4abb-b32b-3130b93bf3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6f44ee23-24d0-41a7-bb81-ea651436486d tempest-VolumesTransfersTest-162710219 None] Created volume successfully. Sep 28 18:03:59 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 Sep 28 18:03:59 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:00 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87" returned: 0 in 0.517s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:00 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87 Sep 28 18:04:00 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-5c693296-c715-4a77-8f28-8cf426f8a414 req-fe60de39-bb1c-4e82-829f-e73ed9eeb2d5 tempest-AttachVolumeNegativeTest-1944563036 None] Terminate volume connection completed successfully. Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-5c693296-c715-4a77-8f28-8cf426f8a414 req-fe60de39-bb1c-4e82-829f-e73ed9eeb2d5 tempest-AttachVolumeNegativeTest-1944563036 None] Deleting attachment a1660eeb-5e47-45f8-90f8-ad76805389d7. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:04:00 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Acquiring lock "cinder-dd581bf7-5e32-4a1b-90dd-59a509315999-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-4e189ac5-d5d1-4274-814d-f725c6db4e87" returned: 0 in 0.573s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-quobyte-4e189ac5-d5d1-4274-814d-f725c6db4e87" released by "delete_volume" :: held 1.176s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-dd581bf7-5e32-4a1b-90dd-59a509315999-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Acquiring lock "cinder-quobyte-dd581bf7-5e32-4a1b-90dd-59a509315999" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:00 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Created reservations ['cc129a74-920c-4e8a-b1a6-d611fb2b7049', 'e217e714-6a65-4409-a546-ca5833cf9ad3', 'e263a44d-8427-4f5a-b019-90806655cd10', '7a9732a3-c545-44a4-b115-989fbe57152b'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-quobyte-dd581bf7-5e32-4a1b-90dd-59a509315999" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3eb5b1-56a7-47a8-a5ac-02e314a8ba00]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:01 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:01 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:01 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 Sep 28 18:04:01 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:01 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.357s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Deleted volume successfully. Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9a1ad401-bb59-4b15-91ba-a6200eb2e937 tempest-AttachVolumeTestJSON-1550402496 None] Lock "cinder-4e189ac5-d5d1-4274-814d-f725c6db4e87-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:01 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999" returned: 0 in 0.565s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:01 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999 Sep 28 18:04:01 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:02 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd581bf7-5e32-4a1b-90dd-59a509315999" returned: 0 in 0.403s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-quobyte-dd581bf7-5e32-4a1b-90dd-59a509315999" released by "delete_volume" :: held 1.047s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Created reservations ['88b1cd79-f292-416b-9783-655b867a4540', 'e1a73c70-fef7-49eb-846c-3e6b73c1b643', 'f408ee13-3275-4d08-affb-97db78658f31', '22df1d59-7ae9-4992-909b-cdb0628cd02e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:02 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:02 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:02 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.439s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Deleted volume successfully. Sep 28 18:04:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a0734867-8df4-40d3-8b94-2fb81b422ed1 tempest-VolumesTransfersTest-1401679209 None] Lock "cinder-dd581bf7-5e32-4a1b-90dd-59a509315999-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "cinder-553eacd7-97d7-4e85-a3ed-580f4e65e57c-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-553eacd7-97d7-4e85-a3ed-580f4e65e57c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "cinder-quobyte-553eacd7-97d7-4e85-a3ed-580f4e65e57c" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-quobyte-553eacd7-97d7-4e85-a3ed-580f4e65e57c" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:09 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770d46c-5838-4e5b-b030-df4da6516fee]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:09 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c Sep 28 18:04:09 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:10 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c" returned: 0 in 0.517s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:10 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c Sep 28 18:04:10 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:10 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-553eacd7-97d7-4e85-a3ed-580f4e65e57c" returned: 0 in 0.427s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-quobyte-553eacd7-97d7-4e85-a3ed-580f4e65e57c" released by "delete_volume" :: held 1.013s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:10 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Created reservations ['277704cd-b4d6-4f85-a46c-f122b46087e9', '0b062811-5dab-42af-a334-1467d724fa49', '2f03b434-2a9a-4ba8-b6d9-3f56c5cfe53f', '13943b24-06f8-4420-8007-0fce92218f33'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:11 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:11 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:11 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Deleted volume successfully. Sep 28 18:04:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8e844c89-1f47-4a53-955a-1d5c3a7193f9 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-553eacd7-97d7-4e85-a3ed-580f4e65e57c-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "cinder-b80848bd-8df8-41cc-bb23-26309759b217-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-b80848bd-8df8-41cc-bb23-26309759b217-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "cinder-quobyte-b80848bd-8df8-41cc-bb23-26309759b217" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-quobyte-b80848bd-8df8-41cc-bb23-26309759b217" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbc5246-421a-4a55-a316-f882628561ad]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:12 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 Sep 28 18:04:12 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:13 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217" returned: 0 in 0.736s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:13 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217 Sep 28 18:04:13 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:13 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b80848bd-8df8-41cc-bb23-26309759b217" returned: 0 in 0.421s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-quobyte-b80848bd-8df8-41cc-bb23-26309759b217" released by "delete_volume" :: held 1.262s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Created reservations ['6d8653e8-304a-47b4-86a0-2aa77d44c266', '2e526816-53ed-4622-a157-b14e0a39808e', '8babd534-8ef8-4915-8a0b-58fe1920bf02', '553c7be1-a666-4e86-aba3-380b4efd1320'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:14 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:14 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:14 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.370s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:14 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Deleted volume successfully. Sep 28 18:04:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-54c48121-4ff3-4b51-b21b-9de544bde3f0 tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-b80848bd-8df8-41cc-bb23-26309759b217-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "cinder-85375504-a7e6-46ea-bc71-824f1feeda18-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-85375504-a7e6-46ea-bc71-824f1feeda18-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "cinder-quobyte-85375504-a7e6-46ea-bc71-824f1feeda18" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-quobyte-85375504-a7e6-46ea-bc71-824f1feeda18" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:15 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[07576e75-b451-4c7a-9d31-98cd6c306117]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:15 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 Sep 28 18:04:15 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:16 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18" returned: 0 in 0.539s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:16 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18 Sep 28 18:04:16 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:16 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-85375504-a7e6-46ea-bc71-824f1feeda18" returned: 0 in 0.540s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-quobyte-85375504-a7e6-46ea-bc71-824f1feeda18" released by "delete_volume" :: held 1.212s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Flow 'volume_create_manager' (31dc595c-ac26-4c9a-91ff-e0d096c7deb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8224bc8-c040-4890-9fcd-d163f935e318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8224bc8-c040-4890-9fcd-d163f935e318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1001333878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f3280-9210-4fd3-868d-0a0eae478ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea9a4293ab742fca9a8daad0befffe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:17Z,use_quota=True,user_id='baa711f8bcd341f392325b70df25a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89232c7f-3294-4b89-af65-1e74d39711e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89232c7f-3294-4b89-af65-1e74d39711e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46f02cf-6841-44c5-8ad3-0b77d5120a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46f02cf-6841-44c5-8ad3-0b77d5120a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694f3280-9210-4fd3-868d-0a0eae478ead', 'volume_name': 'volume-694f3280-9210-4fd3-868d-0a0eae478ead', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8dc210-49d0-4c3d-8473-a4452647d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8dc210-49d0-4c3d-8473-a4452647d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5640ae74-8af5-4e46-8dfc-6e81d160b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:16 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Volume 694f3280-9210-4fd3-868d-0a0eae478ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694f3280-9210-4fd3-868d-0a0eae478ead', 'volume_size': 1} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1001333878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f3280-9210-4fd3-868d-0a0eae478ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea9a4293ab742fca9a8daad0befffe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:17Z,use_quota=True,user_id='baa711f8bcd341f392325b70df25a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Creating volume 694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:16 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:17 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead 1073741824 Sep 28 18:04:17 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Created reservations ['5e76caa4-6a91-40c5-964c-2b2562c09afb', '033b41d7-c3a5-44f7-9224-8d413c5729df', '9b4d117b-62ca-44ee-834f-008871dbc78c', '76a7a782-50b0-4524-97a6-e61b8614a33f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:17 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:17 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:17 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.467s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Deleted volume successfully. Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ca4d859-3946-417f-8d8e-c7a29221a3ef tempest-AttachVolumeNegativeTest-1944563036 None] Lock "cinder-85375504-a7e6-46ea-bc71-824f1feeda18-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:17 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead 1073741824" returned: 0 in 0.963s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:18 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead Sep 28 18:04:18 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:18 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead" returned: 0 in 0.571s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5640ae74-8af5-4e46-8dfc-6e81d160b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694f3280-9210-4fd3-868d-0a0eae478ead', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8af86a9-f3be-4ce9-b3d9-9be31eee12cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:18 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Volume volume-694f3280-9210-4fd3-868d-0a0eae478ead (694f3280-9210-4fd3-868d-0a0eae478ead): created successfully Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8af86a9-f3be-4ce9-b3d9-9be31eee12cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Flow 'volume_create_manager' (31dc595c-ac26-4c9a-91ff-e0d096c7deb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Flow 'volume_create_manager' (a9d356a3-04b5-4fac-9da3-692ac44c5fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fced89b6-8e17-432f-9b8f-5106a831de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:18 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a62d7908-ed31-483f-bbb5-e3a6e29a32b9 tempest-VolumesCloneTest-789620955 None] Created volume successfully. Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fced89b6-8e17-432f-9b8f-5106a831de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1764934643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978af752-da1f-423d-8a18-450826cb62aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb48f19ecf470ab5c1fec3f1a8eac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:19Z,use_quota=True,user_id='65348eca13c7464384a0fe25ccc7eb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ee060c-b429-4a8c-86fe-765b8cc47870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ee060c-b429-4a8c-86fe-765b8cc47870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ab034b-2da3-49b2-ad5d-7ecf4ba7dcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ab034b-2da3-49b2-ad5d-7ecf4ba7dcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978af752-da1f-423d-8a18-450826cb62aa', 'volume_name': 'volume-978af752-da1f-423d-8a18-450826cb62aa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac60a45-99b6-4d5b-8c4a-8a6a6f58bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac60a45-99b6-4d5b-8c4a-8a6a6f58bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ebe52f-7f7e-4468-97e6-0f55e837dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:18 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Volume 978af752-da1f-423d-8a18-450826cb62aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978af752-da1f-423d-8a18-450826cb62aa', 'volume_size': 1} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1764934643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978af752-da1f-423d-8a18-450826cb62aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3cb48f19ecf470ab5c1fec3f1a8eac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:19Z,use_quota=True,user_id='65348eca13c7464384a0fe25ccc7eb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Creating volume 978af752-da1f-423d-8a18-450826cb62aa {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:18 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:19 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa 1073741824 Sep 28 18:04:19 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:19 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa 1073741824" returned: 0 in 0.858s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:19 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa Sep 28 18:04:19 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Flow 'volume_create_manager' (d4b5495a-e82c-40ce-84b8-c796bc2c9f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5862eab6-f428-4f1d-9242-8b867b741438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5862eab6-f428-4f1d-9242-8b867b741438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-704412240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcec364-caa5-4567-9d19-da4d18da5ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea9a4293ab742fca9a8daad0befffe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=694f3280-9210-4fd3-868d-0a0eae478ead,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:20Z,use_quota=True,user_id='baa711f8bcd341f392325b70df25a454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8b1672-2833-4c64-bb89-9e9597f6464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8b1672-2833-4c64-bb89-9e9597f6464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5755fe-b9da-46f4-bfe2-fdbd0a14d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5755fe-b9da-46f4-bfe2-fdbd0a14d822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0bcec364-caa5-4567-9d19-da4d18da5ce3', 'volume_name': 'volume-0bcec364-caa5-4567-9d19-da4d18da5ce3', 'volume_size': 2, 'source_volid': '694f3280-9210-4fd3-868d-0a0eae478ead', 'source_volstatus': 'available'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167a12ff-84ec-49e8-ae52-883adcd1f5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167a12ff-84ec-49e8-ae52-883adcd1f5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a354d1-7d9d-4de7-ae16-f068470eda62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Volume 0bcec364-caa5-4567-9d19-da4d18da5ce3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0bcec364-caa5-4567-9d19-da4d18da5ce3', 'volume_size': 2, 'source_volid': '694f3280-9210-4fd3-868d-0a0eae478ead', 'source_volstatus': 'available'} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:20 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa" returned: 0 in 0.558s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.112s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:20 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Cloning volume 694f3280-9210-4fd3-868d-0a0eae478ead to volume 0bcec364-caa5-4567-9d19-da4d18da5ce3 Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ebe52f-7f7e-4468-97e6-0f55e837dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978af752-da1f-423d-8a18-450826cb62aa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d202d7c-fbf3-4544-ab29-3f0beaf6fe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Creating offline snapshot 79e7b57a-69e9-4339-9b23-3b09f548f68b of volume 694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:04:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Volume volume-978af752-da1f-423d-8a18-450826cb62aa (978af752-da1f-423d-8a18-450826cb62aa): created successfully Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d202d7c-fbf3-4544-ab29-3f0beaf6fe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Flow 'volume_create_manager' (a9d356a3-04b5-4fac-9da3-692ac44c5fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[307f6f84-8f26-4bce-80d7-8336c920a86c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:20 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-4ca02a4e-6905-49e3-8801-b0127009083b req-070fc582-c4db-447d-8f13-01d0583695bb tempest-VolumesGetTestJSON-604688998 None] Created volume successfully. Sep 28 18:04:20 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead Sep 28 18:04:20 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:21 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead" returned: 0 in 0.676s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Acquiring lock "cinder-978af752-da1f-423d-8a18-450826cb62aa-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:21 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b 1G Sep 28 18:04:21 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Lock "cinder-978af752-da1f-423d-8a18-450826cb62aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Acquiring lock "cinder-quobyte-978af752-da1f-423d-8a18-450826cb62aa" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Lock "cinder-quobyte-978af752-da1f-423d-8a18-450826cb62aa" acquired by "delete_volume" :: waited 0.052s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9571d54b-4345-404f-a65b-88cae5554f9d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:21 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa Sep 28 18:04:21 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:21 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b 1G" returned: 0 in 0.581s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f3280-9210-4fd3-868d-0a0eae478ead -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:21 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f3280-9210-4fd3-868d-0a0eae478ead -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b Sep 28 18:04:21 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:22 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa" returned: 0 in 0.515s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:22 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa Sep 28 18:04:22 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:22 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694f3280-9210-4fd3-868d-0a0eae478ead -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b" returned: 0 in 0.536s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:22 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b is being set with open permissions: ugo+rw Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:22 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b Sep 28 18:04:22 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:22 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-978af752-da1f-423d-8a18-450826cb62aa" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Lock "cinder-quobyte-978af752-da1f-423d-8a18-450826cb62aa" released by "delete_volume" :: held 1.009s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG cinder.quota [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Created reservations ['e9e5439f-9ef3-4efa-b222-05bd1b5447eb', 'ddaf1cb4-5459-4d07-8d0c-77ebcc8587c2', 'beb07c14-5594-481e-a552-f650e71be7e9', 'a168c2a1-f33b-4321-aacd-ff4417cc618e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:22 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b" returned: 0 in 0.322s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:22 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:22 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:22 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info Sep 28 18:04:22 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:23 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.273s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.manager [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Deleted volume successfully. Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1543b439-25e0-41a7-9a66-b28ac5698cbd req-1aab53ea-1354-49a2-ba46-e9161c9a9a7c tempest-VolumesGetTestJSON-604688998 None] Lock "cinder-978af752-da1f-423d-8a18-450826cb62aa-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:23 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info" returned: 0 in 0.291s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:23 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info is being set with open permissions: ugo+rw Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:23 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info Sep 28 18:04:23 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:23 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.info" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Acquiring lock "cinder-quobyte-0bcec364-caa5-4567-9d19-da4d18da5ce3" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-0bcec364-caa5-4567-9d19-da4d18da5ce3" acquired by "_copy_volume_from_snapshot" :: waited 0.117s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] snapshot: 79e7b57a-69e9-4339-9b23-3b09f548f68b, volume: 0bcec364-caa5-4567-9d19-da4d18da5ce3, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c40d84e-4773-4dea-aadd-4957ff48592a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:23 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:23 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:23 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b Sep 28 18:04:23 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:24 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.542s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:04:24 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b" returned: 0 in 0.684s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f3280-9210-4fd3-868d-0a0eae478ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc8927-42ef-4f25-b9d9-2ab93b75ba15]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:24 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead Sep 28 18:04:24 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:24 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead" returned: 0 in 0.538s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:04:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:25 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 Sep 28 18:04:25 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:32 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=113,cinder:UPDATE=120,cinder:DELETE=5,cinder:INSERT=36 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:33 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=109,cinder:SELECT=93,cinder:INSERT=28,cinder:DELETE=14 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Flow 'volume_create_manager' (b69dc957-720e-4388-a5c5-a9f0fbc555b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13064536-ac62-4457-a4e4-1aec297d7747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13064536-ac62-4457-a4e4-1aec297d7747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-971719624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a384336f-bb62-4e98-980c-5cdb13ad2645,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8a22002df44b99c779a9f5637ce35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:34Z,use_quota=True,user_id='6ffaa8fb460b492f9e08bcfe300e305d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59abd576-3675-43bf-b39f-f7c3b675e055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59abd576-3675-43bf-b39f-f7c3b675e055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d56a3f-1ca8-4a86-af21-1802552d4398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d56a3f-1ca8-4a86-af21-1802552d4398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a384336f-bb62-4e98-980c-5cdb13ad2645', 'volume_name': 'volume-a384336f-bb62-4e98-980c-5cdb13ad2645', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d144d820-003a-4ea9-83a7-26d5e0b3825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d144d820-003a-4ea9-83a7-26d5e0b3825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2465868-61bb-454a-b1b0-dd379bb8108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Volume a384336f-bb62-4e98-980c-5cdb13ad2645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a384336f-bb62-4e98-980c-5cdb13ad2645', 'volume_size': 1} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:34 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3" returned: 0 in 10.009s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead, size 1024.00 MB, duration 10.01 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:04:34 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Converted 1024.00 MB image at 102.30 MB/s Sep 28 18:04:34 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 is being set with open permissions: ugo+rw Sep 28 18:04:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:35 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 Sep 28 18:04:35 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Flow 'volume_create_manager' (78240a9c-1e62-4c7a-b5cd-3a6f00bc3295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742a6f11-12e4-4ba1-96c8-b1339e3c78de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742a6f11-12e4-4ba1-96c8-b1339e3c78de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1527357266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c583f1c2-eafa-438d-95d9-e4eafbf61ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85090329052a4e04bb87cee19864ce1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:35Z,use_quota=True,user_id='7585e33aebbb477cb124873cc30347e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20397de1-a9c9-4a8d-8b04-9a2a8b90dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20397de1-a9c9-4a8d-8b04-9a2a8b90dfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9045b1-1ab5-4254-a126-12c1085266bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9045b1-1ab5-4254-a126-12c1085266bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c583f1c2-eafa-438d-95d9-e4eafbf61ac8', 'volume_name': 'volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef4e8a9-6616-454f-8e08-6785b305f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef4e8a9-6616-454f-8e08-6785b305f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198a517d-d4dc-4928-95c3-d18ecdb13fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Volume c583f1c2-eafa-438d-95d9-e4eafbf61ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8', 'volume_size': 1} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:35 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3" returned: 0 in 0.272s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-0bcec364-caa5-4567-9d19-da4d18da5ce3" released by "_copy_volume_from_snapshot" :: held 11.665s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Acquiring lock "cinder-quobyte-79e7b57a-69e9-4339-9b23-3b09f548f68b" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-79e7b57a-69e9-4339-9b23-3b09f548f68b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Deleting offline snapshot 79e7b57a-69e9-4339-9b23-3b09f548f68b of volume 694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] snapshot_file for this snap is: volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8528683e-8e6e-4836-b613-7e53a4764b40]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:35 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b Sep 28 18:04:35 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:35 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b" returned: 0 in 0.458s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694f3280-9210-4fd3-868d-0a0eae478ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[db343d17-b4a1-4e58-9ef6-70306ea8e79f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:35 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead Sep 28 18:04:35 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:36 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead" returned: 0 in 0.636s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:36 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b Sep 28 18:04:36 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:36 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b" returned: 0 in 0.427s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:36 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b Sep 28 18:04:36 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:37 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead.79e7b57a-69e9-4339-9b23-3b09f548f68b" returned: 0 in 0.320s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-79e7b57a-69e9-4339-9b23-3b09f548f68b" released by "_delete_snapshot" :: held 1.957s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.811s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.499s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-971719624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a384336f-bb62-4e98-980c-5cdb13ad2645,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8a22002df44b99c779a9f5637ce35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:34Z,use_quota=True,user_id='6ffaa8fb460b492f9e08bcfe300e305d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Creating volume a384336f-bb62-4e98-980c-5cdb13ad2645 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a354d1-7d9d-4de7-ae16-f068470eda62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcec364-caa5-4567-9d19-da4d18da5ce3', 'volume_size': 2, 'source_volid': '694f3280-9210-4fd3-868d-0a0eae478ead', 'source_volstatus': 'available'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:37 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 1073741824 Sep 28 18:04:37 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376f8192-e124-4cec-824d-445d1cddd084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Volume volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 (0bcec364-caa5-4567-9d19-da4d18da5ce3): created successfully Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376f8192-e124-4cec-824d-445d1cddd084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Flow 'volume_create_manager' (d4b5495a-e82c-40ce-84b8-c796bc2c9f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-31f771e0-e211-46ec-bc76-41ca94944e6c tempest-VolumesCloneTest-789620955 None] Created volume successfully. Sep 28 18:04:37 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 1073741824" returned: 0 in 0.494s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:37 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 Sep 28 18:04:37 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645" returned: 0 in 0.264s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.930s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1527357266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c583f1c2-eafa-438d-95d9-e4eafbf61ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85090329052a4e04bb87cee19864ce1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:35Z,use_quota=True,user_id='7585e33aebbb477cb124873cc30347e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Creating volume c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:38 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2465868-61bb-454a-b1b0-dd379bb8108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a384336f-bb62-4e98-980c-5cdb13ad2645', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cd3773-4484-4452-8282-c86081ebaeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:38 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 1073741824 Sep 28 18:04:38 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Volume volume-a384336f-bb62-4e98-980c-5cdb13ad2645 (a384336f-bb62-4e98-980c-5cdb13ad2645): created successfully Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cd3773-4484-4452-8282-c86081ebaeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Flow 'volume_create_manager' (b69dc957-720e-4388-a5c5-a9f0fbc555b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b25b2c72-9337-4c76-8a09-7f99993aaadf tempest-VolumesTestJSON-1280879772 None] Created volume successfully. Sep 28 18:04:38 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 1073741824" returned: 0 in 0.621s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Acquiring lock "cinder-0bcec364-caa5-4567-9d19-da4d18da5ce3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:38 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 Sep 28 18:04:38 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Lock "cinder-0bcec364-caa5-4567-9d19-da4d18da5ce3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Acquiring lock "cinder-quobyte-0bcec364-caa5-4567-9d19-da4d18da5ce3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-0bcec364-caa5-4567-9d19-da4d18da5ce3" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2219340f-ccee-472f-aeb0-9b521a889b10]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:39 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 Sep 28 18:04:39 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:39 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" returned: 0 in 0.379s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198a517d-d4dc-4928-95c3-d18ecdb13fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5462b291-009f-4198-aa4f-e176da855bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Volume volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 (c583f1c2-eafa-438d-95d9-e4eafbf61ac8): created successfully Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5462b291-009f-4198-aa4f-e176da855bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Flow 'volume_create_manager' (78240a9c-1e62-4c7a-b5cd-3a6f00bc3295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-26670004-126a-44eb-95ee-43f44ae6c354 req-828a2b58-cbfd-4aa9-af40-cbcb0b78f0dc tempest-VolumesSnapshotsTestJSON-1127065655 None] Created volume successfully. Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Flow 'volume_create_manager' (10f40750-2805-4560-ab70-9a22eca474f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51dcc28-d4d8-4ee5-a3ea-ee57dba46601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51dcc28-d4d8-4ee5-a3ea-ee57dba46601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-264792134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4a839b-8169-4e06-a131-8519733f2682,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8a22002df44b99c779a9f5637ce35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:39Z,use_quota=True,user_id='6ffaa8fb460b492f9e08bcfe300e305d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d8888d-ca12-4c03-a723-accf53e1e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d8888d-ca12-4c03-a723-accf53e1e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57313aca-e0db-437b-acfe-3bc417c25713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57313aca-e0db-437b-acfe-3bc417c25713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf4a839b-8169-4e06-a131-8519733f2682', 'volume_name': 'volume-bf4a839b-8169-4e06-a131-8519733f2682', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c95d29-7beb-4bed-831a-fd0f04480b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c95d29-7beb-4bed-831a-fd0f04480b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc009570-0bb6-42bd-ba7f-9c058674b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Volume bf4a839b-8169-4e06-a131-8519733f2682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf4a839b-8169-4e06-a131-8519733f2682', 'volume_size': 1} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-264792134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4a839b-8169-4e06-a131-8519733f2682,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8a22002df44b99c779a9f5637ce35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:39Z,use_quota=True,user_id='6ffaa8fb460b492f9e08bcfe300e305d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Creating volume bf4a839b-8169-4e06-a131-8519733f2682 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:39 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:39 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 1073741824 Sep 28 18:04:39 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:39 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3" returned: 0 in 0.561s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:39 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3 Sep 28 18:04:39 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:39 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0bcec364-caa5-4567-9d19-da4d18da5ce3" returned: 0 in 0.363s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-0bcec364-caa5-4567-9d19-da4d18da5ce3" released by "delete_volume" :: held 0.994s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Created reservations ['97aef323-4943-4df2-9e18-2811a4cf36fb', '4d80aad8-1e84-486e-8767-c77392e1ea22', '9ea1aff2-07d2-43f9-a97c-5857751ba49d', 'ceaf2dc6-be60-4589-b74d-d0be35ecf6e2'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:40 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:40 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:40 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 1073741824" returned: 0 in 0.774s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:40 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 Sep 28 18:04:40 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:40 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.361s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Deleted volume successfully. Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-22306601-644c-4ea5-9ead-379d238ecda6 tempest-VolumesCloneTest-789620955 None] Lock "cinder-0bcec364-caa5-4567-9d19-da4d18da5ce3-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:40 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682" returned: 0 in 0.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.795s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Creating offline snapshot fedb87e7-5561-4f5a-b479-d92e213cb49d of volume c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc009570-0bb6-42bd-ba7f-9c058674b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4a839b-8169-4e06-a131-8519733f2682', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa50d514-8d3f-4178-8344-554da451fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8551ed-eb59-4205-888f-2c2cf1d736ba]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Volume volume-bf4a839b-8169-4e06-a131-8519733f2682 (bf4a839b-8169-4e06-a131-8519733f2682): created successfully Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa50d514-8d3f-4178-8344-554da451fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Flow 'volume_create_manager' (10f40750-2805-4560-ab70-9a22eca474f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a5400e7d-c5a6-4201-a2f1-f932a5cc00f7 tempest-VolumesTestJSON-1280879772 None] Created volume successfully. Sep 28 18:04:40 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 Sep 28 18:04:40 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-e8edf267-70af-44f3-a170-b7756350b6e5 req-9fa34213-62ef-4652-9d67-90a5a8ff9786 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:41 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" returned: 0 in 0.503s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Acquiring lock "cinder-694f3280-9210-4fd3-868d-0a0eae478ead-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:41 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d 1G Sep 28 18:04:41 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Lock "cinder-694f3280-9210-4fd3-868d-0a0eae478ead-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Acquiring lock "cinder-quobyte-694f3280-9210-4fd3-868d-0a0eae478ead" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-694f3280-9210-4fd3-868d-0a0eae478ead" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[222d370d-e136-4426-a90c-6897215c4e76]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:41 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead Sep 28 18:04:41 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:41 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d 1G" returned: 0 in 0.570s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:41 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d Sep 28 18:04:41 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:41 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:41 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead Sep 28 18:04:41 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:42 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d" returned: 0 in 0.422s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:42 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d is being set with open permissions: ugo+rw Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:42 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:42 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d Sep 28 18:04:42 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-694f3280-9210-4fd3-868d-0a0eae478ead" returned: 0 in 0.329s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Lock "cinder-quobyte-694f3280-9210-4fd3-868d-0a0eae478ead" released by "delete_volume" :: held 0.925s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Flow 'volume_create_manager' (ccf17791-faae-4162-bbf8-e2b89b8cfbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0f37d5-3965-49e6-a738-6e7810a6c931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0f37d5-3965-49e6-a738-6e7810a6c931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1966619230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e12264-036b-4457-b8c1-46986b1b711d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8a22002df44b99c779a9f5637ce35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:42Z,use_quota=True,user_id='6ffaa8fb460b492f9e08bcfe300e305d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75c0984-1d7a-41e0-a874-9eed8704e740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75c0984-1d7a-41e0-a874-9eed8704e740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d885a62a-56e8-44db-92f4-ea3bff660d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d885a62a-56e8-44db-92f4-ea3bff660d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e12264-036b-4457-b8c1-46986b1b711d', 'volume_name': 'volume-b3e12264-036b-4457-b8c1-46986b1b711d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346f7ad0-9df2-476b-a14a-26b7a4991db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346f7ad0-9df2-476b-a14a-26b7a4991db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20897457-81b7-4db9-80b1-968dbbe7384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Volume b3e12264-036b-4457-b8c1-46986b1b711d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e12264-036b-4457-b8c1-46986b1b711d', 'volume_size': 1} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Created reservations ['a4a07773-db23-420c-a82b-db9264135af3', 'ece5811f-5c55-456c-94c0-800b1916ee9c', '2d7c0125-44d0-4122-96fc-aaca40072a54', '067b53a1-7679-46a3-b6bd-70be3f59af6a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:42 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d" returned: 0 in 0.281s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:42 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:42 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:42 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info Sep 28 18:04:42 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:42 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.289s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Deleted volume successfully. Sep 28 18:04:42 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info" returned: 0 in 0.300s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:42 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info is being set with open permissions: ugo+rw Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-799daf2e-79ce-475d-91b8-7c12aac0f82f tempest-VolumesCloneTest-789620955 None] Lock "cinder-694f3280-9210-4fd3-868d-0a0eae478ead-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:42 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info Sep 28 18:04:42 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:43 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.info" returned: 0 in 0.266s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-e8edf267-70af-44f3-a170-b7756350b6e5 req-9fa34213-62ef-4652-9d67-90a5a8ff9786 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.035s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-e8edf267-70af-44f3-a170-b7756350b6e5 req-9fa34213-62ef-4652-9d67-90a5a8ff9786 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1966619230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e12264-036b-4457-b8c1-46986b1b711d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8a22002df44b99c779a9f5637ce35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:42Z,use_quota=True,user_id='6ffaa8fb460b492f9e08bcfe300e305d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Creating volume b3e12264-036b-4457-b8c1-46986b1b711d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:43 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:43 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d 1073741824 Sep 28 18:04:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-6560f695-d57b-4e1a-8921-efdcb6eef621 req-31bf07cb-4410-43bf-8116-bf26fba1f9e9 tempest-VolumesSnapshotsTestJSON-1127065655 None] Create snapshot completed successfully Sep 28 18:04:43 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-e8edf267-70af-44f3-a170-b7756350b6e5 req-9fa34213-62ef-4652-9d67-90a5a8ff9786 tempest-ServerActionsTestOtherA-297840239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de716cec-5fab-4a1a-b262-7ddc7fa951b5', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:04:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-e8edf267-70af-44f3-a170-b7756350b6e5 req-9fa34213-62ef-4652-9d67-90a5a8ff9786 tempest-ServerActionsTestOtherA-297840239 None] attachment_update completed successfully. Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "cinder-fedb87e7-5561-4f5a-b479-d92e213cb49d-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-fedb87e7-5561-4f5a-b479-d92e213cb49d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "cinder-quobyte-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-quobyte-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "cinder-quobyte-fedb87e7-5561-4f5a-b479-d92e213cb49d" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-quobyte-fedb87e7-5561-4f5a-b479-d92e213cb49d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Deleting offline snapshot fedb87e7-5561-4f5a-b479-d92e213cb49d of volume c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] snapshot_file for this snap is: volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c20519-4ff6-4715-9a23-7bb42fe74b75]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:43 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d Sep 28 18:04:43 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:43 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d 1073741824" returned: 0 in 0.738s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:43 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d Sep 28 18:04:43 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:44 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d" returned: 0 in 0.517s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bfb940-53e0-49c0-b402-381201dc8c52]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:44 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d" returned: 0 in 0.516s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20897457-81b7-4db9-80b1-968dbbe7384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e12264-036b-4457-b8c1-46986b1b711d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6948786b-0023-4b30-85db-8bd61d625c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:44 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Volume volume-b3e12264-036b-4457-b8c1-46986b1b711d (b3e12264-036b-4457-b8c1-46986b1b711d): created successfully Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6948786b-0023-4b30-85db-8bd61d625c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:44 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 Sep 28 18:04:44 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Flow 'volume_create_manager' (ccf17791-faae-4162-bbf8-e2b89b8cfbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-59a2387e-c10d-49bd-aa35-bac16fb77cb5 tempest-VolumesTestJSON-1280879772 None] Created volume successfully. Sep 28 18:04:44 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" returned: 0 in 0.611s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:44 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d Sep 28 18:04:44 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:45 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d" returned: 0 in 0.432s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:45 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d Sep 28 18:04:45 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:45 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8.fedb87e7-5561-4f5a-b479-d92e213cb49d" returned: 0 in 0.302s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-quobyte-fedb87e7-5561-4f5a-b479-d92e213cb49d" released by "_delete_snapshot" :: held 2.089s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-quobyte-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" released by "delete_snapshot" :: held 2.138s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG cinder.quota [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Created reservations ['028c6f63-57cc-4463-a808-dd574502b01f', '4bf12d48-94fc-4fad-ae0b-9f1a82a5c3ff', '1d68de60-d2ca-49cd-a6c8-6ff20c270d63', '0ea05051-17a0-4d16-8d60-14be72e6dcb0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Delete snapshot completed successfully. Sep 28 18:04:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1d8327ac-1bff-473c-b029-d75400229669 req-fd686745-d24a-4a83-81fc-cac1164a48a0 tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-fedb87e7-5561-4f5a-b479-d92e213cb49d-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "cinder-c583f1c2-eafa-438d-95d9-e4eafbf61ac8-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-c583f1c2-eafa-438d-95d9-e4eafbf61ac8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "cinder-quobyte-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-quobyte-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8529b-047d-4fd5-b032-5376bba5b0d7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:46 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 Sep 28 18:04:46 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:47 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" returned: 0 in 0.553s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:47 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8 Sep 28 18:04:47 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "cinder-b3e12264-036b-4457-b8c1-46986b1b711d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-b3e12264-036b-4457-b8c1-46986b1b711d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "cinder-quobyte-b3e12264-036b-4457-b8c1-46986b1b711d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:47 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" returned: 0 in 0.482s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-quobyte-b3e12264-036b-4457-b8c1-46986b1b711d" acquired by "delete_volume" :: waited 0.058s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-quobyte-c583f1c2-eafa-438d-95d9-e4eafbf61ac8" released by "delete_volume" :: held 1.216s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6eb604-fda1-42c7-9bc0-1c1ff71165e1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.quota [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Created reservations ['9ae5c516-d09f-47d9-a41d-bd70e5791498', '62241aee-55b3-41ed-bfef-9653f5dfa8da', '23c6dd49-3ba0-4c7c-bc0b-266f13a71d4a', '28a24386-9944-4120-9e23-b9e1ce8b4328'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:47 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d Sep 28 18:04:47 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:47 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:47 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:48 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d" returned: 0 in 0.564s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:48 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.360s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.manager [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:48 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d Sep 28 18:04:48 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Deleted volume successfully. Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-b2ffd290-7142-4007-9789-e9de87f3de19 req-723c1704-a72d-4870-93d8-9755a100845c tempest-VolumesSnapshotsTestJSON-1127065655 None] Lock "cinder-c583f1c2-eafa-438d-95d9-e4eafbf61ac8-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:48 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b3e12264-036b-4457-b8c1-46986b1b711d" returned: 0 in 0.322s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-quobyte-b3e12264-036b-4457-b8c1-46986b1b711d" released by "delete_volume" :: held 0.973s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-d04627b1-7dc0-4a89-87e3-6d9f82639e96 tempest-ServerActionsTestOtherA-297840239 None] Terminate volume connection completed successfully. Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-d04627b1-7dc0-4a89-87e3-6d9f82639e96 tempest-ServerActionsTestOtherA-297840239 None] Deleting attachment de716cec-5fab-4a1a-b262-7ddc7fa951b5. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Created reservations ['1cbde2c7-4a31-4e32-9730-96f6460ef60b', '40639246-2f15-4dbc-b952-e648ce145762', '7c8b3ece-2f78-4ad1-91c6-f39efdc9f325', '279ea9c7-1375-4fa4-9c8e-483c913ad60c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:48 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:48 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Acquiring lock "cinder-bf4a839b-8169-4e06-a131-8519733f2682-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Lock "cinder-bf4a839b-8169-4e06-a131-8519733f2682-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:49 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Acquiring lock "cinder-quobyte-bf4a839b-8169-4e06-a131-8519733f2682" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:49 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Deleted volume successfully. Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Lock "cinder-quobyte-bf4a839b-8169-4e06-a131-8519733f2682" acquired by "delete_volume" :: waited 0.069s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99c32583-ba24-476a-923d-08c96e126f37 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-b3e12264-036b-4457-b8c1-46986b1b711d-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a197a-ab4e-4373-b4f0-8ca784471df3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:49 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 Sep 28 18:04:49 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Flow 'volume_create_manager' (2c384995-af5f-4d38-b77a-47fa409b8d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e06e3c-894f-4318-85cf-2163a3021072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e06e3c-894f-4318-85cf-2163a3021072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-340321303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d26aed1-6449-40fc-af6b-daaaa5d97451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc507b4bf484b7aaebf2295eaa7561a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:50Z,use_quota=True,user_id='d3a87d5a89fc4250944f9c09201f8cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8343966-b121-431f-a5b4-375190290a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8343966-b121-431f-a5b4-375190290a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0675d92-5a7c-47d7-a8ca-7f582b0cc379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0675d92-5a7c-47d7-a8ca-7f582b0cc379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d26aed1-6449-40fc-af6b-daaaa5d97451', 'volume_name': 'volume-8d26aed1-6449-40fc-af6b-daaaa5d97451', 'volume_size': 2}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7ec2f2-000a-4832-9b0f-f8cdfd1001eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7ec2f2-000a-4832-9b0f-f8cdfd1001eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca97aad-ab08-4f49-9099-ea83c5e18941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:49 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Volume 8d26aed1-6449-40fc-af6b-daaaa5d97451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d26aed1-6449-40fc-af6b-daaaa5d97451', 'volume_size': 2} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-340321303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d26aed1-6449-40fc-af6b-daaaa5d97451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc507b4bf484b7aaebf2295eaa7561a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:50Z,use_quota=True,user_id='d3a87d5a89fc4250944f9c09201f8cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Creating volume 8d26aed1-6449-40fc-af6b-daaaa5d97451 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:50 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 2147483648 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:50 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 2147483648 Sep 28 18:04:50 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-69e3ab72-8e84-4a6b-a0db-74ff9839a7c2 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:50 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682" returned: 0 in 0.666s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:50 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682 Sep 28 18:04:50 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:50 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bf4a839b-8169-4e06-a131-8519733f2682" returned: 0 in 0.453s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Lock "cinder-quobyte-bf4a839b-8169-4e06-a131-8519733f2682" released by "delete_volume" :: held 1.275s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Created reservations ['45b90443-ca68-4831-bfb0-0ba7255cdc6b', 'ef2ea5c7-d3cc-4b39-a907-1db3e4b87fe3', '43703be1-47b5-4f46-927b-5caf4dad6a1d', '6c8c71f5-f6e5-4b92-a699-acb853d1f76a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:50 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 2147483648" returned: 0 in 0.815s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:50 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 Sep 28 18:04:50 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:50 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:50 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:51 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451" returned: 0 in 0.313s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-69e3ab72-8e84-4a6b-a0db-74ff9839a7c2 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.053s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca97aad-ab08-4f49-9099-ea83c5e18941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d26aed1-6449-40fc-af6b-daaaa5d97451', 'volume_size': 2}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787cd576-7b47-4337-b761-87ed398b8dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-69e3ab72-8e84-4a6b-a0db-74ff9839a7c2 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Volume volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 (8d26aed1-6449-40fc-af6b-daaaa5d97451): created successfully Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787cd576-7b47-4337-b761-87ed398b8dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Flow 'volume_create_manager' (2c384995-af5f-4d38-b77a-47fa409b8d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:51 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.334s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Deleted volume successfully. Sep 28 18:04:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-38ae50ba-8380-4046-98b4-4ebba922092d tempest-VolumesCloneNegativeTest-1929896194 None] Created volume successfully. Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-69e3ab72-8e84-4a6b-a0db-74ff9839a7c2 tempest-ServerActionsTestOtherA-297840239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3157bc52-d07b-4a51-bf7f-a491cf659af3', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e72c08dc-8956-49c8-a66f-6c0a01544def tempest-VolumesTestJSON-1280879772 None] Lock "cinder-bf4a839b-8169-4e06-a131-8519733f2682-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c88112fb-b746-4196-be3b-bac089fbaa2f req-69e3ab72-8e84-4a6b-a0db-74ff9839a7c2 tempest-ServerActionsTestOtherA-297840239 None] attachment_update completed successfully. Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "cinder-a384336f-bb62-4e98-980c-5cdb13ad2645-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-a384336f-bb62-4e98-980c-5cdb13ad2645-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "cinder-quobyte-a384336f-bb62-4e98-980c-5cdb13ad2645" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-quobyte-a384336f-bb62-4e98-980c-5cdb13ad2645" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a815fa77-7f37-4c48-a805-f4266178f8f6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:51 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 Sep 28 18:04:51 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Acquiring lock "cinder-8d26aed1-6449-40fc-af6b-daaaa5d97451-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Lock "cinder-8d26aed1-6449-40fc-af6b-daaaa5d97451-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Acquiring lock "cinder-quobyte-8d26aed1-6449-40fc-af6b-daaaa5d97451" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:04:52 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645" returned: 0 in 0.666s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Lock "cinder-quobyte-8d26aed1-6449-40fc-af6b-daaaa5d97451" acquired by "delete_volume" :: waited 0.053s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:04:52 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645 Sep 28 18:04:52 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec37ae7-dd70-4e2d-9619-38ee44fc4065]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:52 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 Sep 28 18:04:52 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:52 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a384336f-bb62-4e98-980c-5cdb13ad2645" returned: 0 in 0.375s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-quobyte-a384336f-bb62-4e98-980c-5cdb13ad2645" released by "delete_volume" :: held 1.139s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:52 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Created reservations ['ff67dbe7-d07c-4c96-b81e-91c33b168231', '3a155142-02fe-4dd8-b297-599bbcd3cd5e', '99001514-48e4-4dca-82f3-e35b5e8caa92', '089cf4c8-c862-49d9-96cd-95041196eee7'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:53 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451" returned: 0 in 0.525s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:53 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:53 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:53 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451 Sep 28 18:04:53 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:53 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.518s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Deleted volume successfully. Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9465f3d6-a012-4921-b221-250b514b4442 tempest-VolumesTestJSON-1280879772 None] Lock "cinder-a384336f-bb62-4e98-980c-5cdb13ad2645-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:53 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d26aed1-6449-40fc-af6b-daaaa5d97451" returned: 0 in 0.624s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Lock "cinder-quobyte-8d26aed1-6449-40fc-af6b-daaaa5d97451" released by "delete_volume" :: held 1.226s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:53 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Created reservations ['822b93cf-23da-461d-bd50-5ae32b79d71e', 'c84f25eb-3908-4ee7-aa23-cadbb10856d6', '101aa43c-d6d9-43ea-bae9-09931512576a', 'a8d308c1-df84-4d52-b07c-82b1997b4b05'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:54 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:04:54 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:54 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Deleted volume successfully. Sep 28 18:04:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48a3228b-3267-4931-a1c2-c8b7d74383bf tempest-VolumesCloneNegativeTest-1929896194 None] Lock "cinder-8d26aed1-6449-40fc-af6b-daaaa5d97451-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:04:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5fbf0bfc-028f-4cdb-9910-7fbf1ab300a4 tempest-GroupSnapshotsTest-773219606 None] Group tempest-GroupSnapshotsTest-Group-1203668348: creating Sep 28 18:04:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5fbf0bfc-028f-4cdb-9910-7fbf1ab300a4 tempest-GroupSnapshotsTest-773219606 None] Group tempest-GroupSnapshotsTest-Group-1203668348: created successfully Sep 28 18:04:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5fbf0bfc-028f-4cdb-9910-7fbf1ab300a4 tempest-GroupSnapshotsTest-773219606 None] Create group completed successfully. Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (3543634e-c9af-41a6-8746-7995854707f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc374e1-df52-4a1d-915d-b37dbbc69abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc374e1-df52-4a1d-915d-b37dbbc69abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1771363071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0c5b851-d76c-4dcc-b571-3f9a0ecbe250,host='devstack@QuobyteHD#QuobyteHD',id=319b927d-39e1-435a-b310-1a30394a57cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:02Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f453beb3-aeea-4038-a32b-ed019d1ba0f3),volume_type_id=f453beb3-aeea-4038-a32b-ed019d1ba0f3)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d27e11-761d-4ef4-b25f-8aacc9f425f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d27e11-761d-4ef4-b25f-8aacc9f425f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a8f422-0f68-4cb1-9e7c-537bf28cad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a8f422-0f68-4cb1-9e7c-537bf28cad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319b927d-39e1-435a-b310-1a30394a57cb', 'volume_name': 'volume-319b927d-39e1-435a-b310-1a30394a57cb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a423a2-79db-41a4-834a-291a7beae063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a423a2-79db-41a4-834a-291a7beae063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76ac910-f644-4621-88f5-83fa61275484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:01 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Volume 319b927d-39e1-435a-b310-1a30394a57cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319b927d-39e1-435a-b310-1a30394a57cb', 'volume_size': 1} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0c5b851-d76c-4dcc-b571-3f9a0ecbe250,created_at=2026-09-28T16:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1771363071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0c5b851-d76c-4dcc-b571-3f9a0ecbe250,host='devstack@QuobyteHD#QuobyteHD',id=319b927d-39e1-435a-b310-1a30394a57cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:02Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f453beb3-aeea-4038-a32b-ed019d1ba0f3),volume_type_id=f453beb3-aeea-4038-a32b-ed019d1ba0f3)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Creating volume 319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:01 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:05:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:01 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb 1073741824 Sep 28 18:05:01 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:02 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb 1073741824" returned: 0 in 0.751s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:02 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb Sep 28 18:05:02 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:02 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb" returned: 0 in 0.403s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76ac910-f644-4621-88f5-83fa61275484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319b927d-39e1-435a-b310-1a30394a57cb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7a4770-8d39-4558-9333-a6ba33355b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-05df0481-f08f-4d63-ada8-94785fd3d00f tempest-BackendsCapabilitiesAdminTestsJSON-851407958 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87096) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:05:03 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Volume volume-319b927d-39e1-435a-b310-1a30394a57cb (319b927d-39e1-435a-b310-1a30394a57cb): created successfully Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7a4770-8d39-4558-9333-a6ba33355b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (3543634e-c9af-41a6-8746-7995854707f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:03 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e5a1284e-3581-42d9-8f46-ebaf6c76aeb8 tempest-GroupSnapshotsTest-773219606 None] Created volume successfully. Sep 28 18:05:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a377c8e5-76f3-48ec-a469-2a5d5fa1c87e tempest-BackendsCapabilitiesAdminTestsJSON-851407958 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87096) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:05:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] GroupSnapshot 824d899c-2a52-4a1e-830a-005905c5150a: creating. Sep 28 18:05:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Group snapshot 824d899c-2a52-4a1e-830a-005905c5150a: creating. {{(pid=87096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:05:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Creating offline snapshot 24993755-0fa0-46fd-914d-0f34a3e3e820 of volume 319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:04 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73bd30c-21d0-496e-a2e8-85db904398d8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:04 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb Sep 28 18:05:04 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:05 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:05 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 1G Sep 28 18:05:05 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:06 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 1G" returned: 0 in 0.761s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-319b927d-39e1-435a-b310-1a30394a57cb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:06 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-319b927d-39e1-435a-b310-1a30394a57cb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 Sep 28 18:05:06 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:06 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-319b927d-39e1-435a-b310-1a30394a57cb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820" returned: 0 in 0.604s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:06 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:06 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 Sep 28 18:05:06 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:07 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820" returned: 0 in 0.462s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:07 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info Sep 28 18:05:07 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:07 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info" returned: 0 in 0.338s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:07 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:07 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info Sep 28 18:05:07 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:07 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.info" returned: 0 in 0.288s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-635ca4ca-e2fa-47d5-a882-dc10921ea5af tempest-GroupSnapshotsTest-773219606 None] group_snapshot 824d899c-2a52-4a1e-830a-005905c5150a: created successfully Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-24993755-0fa0-46fd-914d-0f34a3e3e820-dbac5be8-f864-46e4-83b7-c81e73ac8acb" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-24993755-0fa0-46fd-914d-0f34a3e3e820-dbac5be8-f864-46e4-83b7-c81e73ac8acb" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Creating volume dbac5be8-f864-46e4-83b7-c81e73ac8acb from snapshot 24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-dbac5be8-f864-46e4-83b7-c81e73ac8acb" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-dbac5be8-f864-46e4-83b7-c81e73ac8acb" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] snapshot: 24993755-0fa0-46fd-914d-0f34a3e3e820, volume: dbac5be8-f864-46e4-83b7-c81e73ac8acb, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1551d866-9483-461e-b52a-f801f3d2dd94]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:11 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 Sep 28 18:05:11 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:11 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820" returned: 0 in 0.871s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-319b927d-39e1-435a-b310-1a30394a57cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[166309ec-ecf0-4b9a-a315-f572a559d1a0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:12 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb Sep 28 18:05:12 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:12 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb" returned: 0 in 0.607s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:05:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:05:12 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:05:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:12 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb Sep 28 18:05:12 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:20 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=88,cinder:SELECT=72,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:20 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=90,cinder:UPDATE=93,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (409ae23c-5140-4a37-9510-27e598347dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613ca8bb-870c-4f80-b852-1fbc365a4f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613ca8bb-870c-4f80-b852-1fbc365a4f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-900941433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f6ab49-b320-4916-811c-9a9e88ab33d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:22Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6282cda4-e040-476f-95c6-c7859a7e110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6282cda4-e040-476f-95c6-c7859a7e110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2e1299-ce0c-4f38-84a9-218da9624ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2e1299-ce0c-4f38-84a9-218da9624ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f6ab49-b320-4916-811c-9a9e88ab33d4', 'volume_name': 'volume-64f6ab49-b320-4916-811c-9a9e88ab33d4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2749d78c-87e0-4cd1-b030-07ff90662a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2749d78c-87e0-4cd1-b030-07ff90662a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686ebd8a-bbf1-4a90-8c36-c51126e459d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:22 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume 64f6ab49-b320-4916-811c-9a9e88ab33d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f6ab49-b320-4916-811c-9a9e88ab33d4', 'volume_size': 1} Sep 28 18:05:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:22 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb" returned: 0 in 10.453s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:22 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb, size 1024.00 MB, duration 10.45 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:05:22 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Converted 1024.00 MB image at 97.96 MB/s Sep 28 18:05:22 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:22 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb Sep 28 18:05:22 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:23 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb" returned: 0 in 0.305s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-dbac5be8-f864-46e4-83b7-c81e73ac8acb" released by "_copy_volume_from_snapshot" :: held 12.431s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-24993755-0fa0-46fd-914d-0f34a3e3e820-dbac5be8-f864-46e4-83b7-c81e73ac8acb" released by "_create_volume_from_snapshot" :: held 12.541s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.566s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.250s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-900941433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f6ab49-b320-4916-811c-9a9e88ab33d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:22Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating volume 64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:23 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:23 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 1073741824 Sep 28 18:05:23 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0a9cdd4e-ad21-463d-9eb0-b9c3c29d8a87 tempest-GroupSnapshotsTest-773219606 None] Create group from source-snapshot-824d899c-2a52-4a1e-830a-005905c5150a completed successfully. Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:23 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:05:23 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:24 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:05:24 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 1073741824" returned: 0 in 0.948s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-0b74c924-33b5-425e-8ecb-ea1c92af3f80 req-ae91160c-5b56-49e8-b37c-4d43d6914774 tempest-ServerActionsTestOtherA-297840239 None] Terminate volume connection completed successfully. Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-0b74c924-33b5-425e-8ecb-ea1c92af3f80 req-ae91160c-5b56-49e8-b37c-4d43d6914774 tempest-ServerActionsTestOtherA-297840239 None] Deleting attachment 3157bc52-d07b-4a51-bf7f-a491cf659af3. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:24 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 Sep 28 18:05:24 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-dbac5be8-f864-46e4-83b7-c81e73ac8acb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-dbac5be8-f864-46e4-83b7-c81e73ac8acb" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:24 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4" returned: 0 in 0.434s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686ebd8a-bbf1-4a90-8c36-c51126e459d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f6ab49-b320-4916-811c-9a9e88ab33d4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131c5dd7-d2a2-42b3-bfdf-2114325cdf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f6929-b902-46f7-b5f1-e54a86640a93]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:24 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 (64f6ab49-b320-4916-811c-9a9e88ab33d4): created successfully Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131c5dd7-d2a2-42b3-bfdf-2114325cdf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (409ae23c-5140-4a37-9510-27e598347dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c87b191c-ee2d-4f22-ad82-2ff5ab112764 tempest-VolumesSnapshotTestJSON-1251967255 None] Created volume successfully. Sep 28 18:05:25 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb Sep 28 18:05:25 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:25 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb" returned: 0 in 0.588s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:25 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb Sep 28 18:05:25 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:25 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dbac5be8-f864-46e4-83b7-c81e73ac8acb" returned: 0 in 0.490s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-dbac5be8-f864-46e4-83b7-c81e73ac8acb" released by "delete_volume" :: held 1.181s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['bb7f35d4-a8cb-490c-aaba-ce40b8abd384'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:26 devstack cinder-volume[87096]: WARNING cinder.quota [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1228364844 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1228364844, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:26 devstack cinder-volume[87096]: WARNING cinder.quota [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1228364844 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1228364844, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['236b0196-7825-4ffb-a8dd-1b4f8e93b96a', '4b6d361c-2022-446b-bd58-ea89a6f710cd', '890f926c-4419-4736-b5ca-25a5f2ac47d5', '413d01d3-4d14-43fc-8240-0664cfaabcb0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating offline snapshot b6411a5c-f945-435e-b85a-a46659b0ad64 of volume 64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[251807c9-cb7b-4ce8-becc-cf3fbf4adeb5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:26 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 Sep 28 18:05:26 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:26 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:05:26 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:27 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.361s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:27 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-07d38249-4ca8-4f5f-9b87-3fb51460f0f1 tempest-GroupSnapshotsTest-773219606 None] Delete group completed successfully. Sep 28 18:05:27 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4" returned: 0 in 0.654s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:27 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 1G Sep 28 18:05:27 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:27 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 824d899c-2a52-4a1e-830a-005905c5150a: deleting Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 824d899c-2a52-4a1e-830a-005905c5150a: deleting {{(pid=87096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-319b927d-39e1-435a-b310-1a30394a57cb" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-319b927d-39e1-435a-b310-1a30394a57cb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-24993755-0fa0-46fd-914d-0f34a3e3e820" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-24993755-0fa0-46fd-914d-0f34a3e3e820" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Deleting offline snapshot 24993755-0fa0-46fd-914d-0f34a3e3e820 of volume 319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:27 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] snapshot_file for this snap is: volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 1G" returned: 0 in 0.758s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c8b33-86d3-46c5-9de8-faf05b13ada1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:27 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 Sep 28 18:05:27 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:28 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 Sep 28 18:05:28 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:28 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64" returned: 0 in 0.489s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:28 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 is being set with open permissions: ugo+rw Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:28 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 Sep 28 18:05:28 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:28 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820" returned: 0 in 0.604s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-319b927d-39e1-435a-b310-1a30394a57cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e12a605-660c-4174-840a-9397ae6b82ab]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:28 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb Sep 28 18:05:28 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:28 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:28 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info Sep 28 18:05:28 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:29 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:29 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb" returned: 0 in 0.728s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info" returned: 0 in 0.428s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:29 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info is being set with open permissions: ugo+rw Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:29 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 Sep 28 18:05:29 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:29 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info Sep 28 18:05:29 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:29 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.info" returned: 0 in 0.413s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.417s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:29 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820" returned: 0 in 0.548s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e12efe51-7c1b-4a89-a681-31175bf9acc0 tempest-VolumesSnapshotTestJSON-1251967255 None] Create snapshot completed successfully Sep 28 18:05:29 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820 Sep 28 18:05:29 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:30 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb.24993755-0fa0-46fd-914d-0f34a3e3e820" returned: 0 in 0.438s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-24993755-0fa0-46fd-914d-0f34a3e3e820" released by "_delete_snapshot" :: held 2.520s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-319b927d-39e1-435a-b310-1a30394a57cb" released by "delete_snapshot" :: held 2.578s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:30 devstack cinder-volume[87096]: WARNING cinder.quota [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1228364844 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1228364844, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['e7953632-d573-4a83-bcd6-c510e0870f87', '13435764-258d-4bca-9c96-31db83d90202', '01637a66-8c49-4234-8eb3-3e4beb85efec', '8dde7cb8-06a4-47d4-a10e-2cca7a1a972d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:30 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-65a5ad0c-42f0-45e8-b810-5013a058c638 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 824d899c-2a52-4a1e-830a-005905c5150a: deleted successfully Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-b6411a5c-f945-435e-b85a-a46659b0ad64-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-b6411a5c-f945-435e-b85a-a46659b0ad64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-64f6ab49-b320-4916-811c-9a9e88ab33d4" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-64f6ab49-b320-4916-811c-9a9e88ab33d4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-b6411a5c-f945-435e-b85a-a46659b0ad64" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-b6411a5c-f945-435e-b85a-a46659b0ad64" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleting offline snapshot b6411a5c-f945-435e-b85a-a46659b0ad64 of volume 64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] snapshot_file for this snap is: volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd940f-2525-46f8-892b-77b64f07060c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:31 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 Sep 28 18:05:31 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-319b927d-39e1-435a-b310-1a30394a57cb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-319b927d-39e1-435a-b310-1a30394a57cb" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6966e5-4772-416d-8ae3-bf1f98dfc994]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:31 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64" returned: 0 in 0.694s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64f6ab49-b320-4916-811c-9a9e88ab33d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddfef9d-46d5-48ef-910f-ffbb9c781303]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:31 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb Sep 28 18:05:31 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:31 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 Sep 28 18:05:31 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb" returned: 0 in 0.532s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:32 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4" returned: 0 in 0.470s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:32 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb Sep 28 18:05:32 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 Sep 28 18:05:32 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-319b927d-39e1-435a-b310-1a30394a57cb" returned: 0 in 0.389s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-319b927d-39e1-435a-b310-1a30394a57cb" released by "delete_volume" :: held 1.051s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Created reservations ['d4a60c65-db83-4166-9521-77256cf9491e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:32 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64" returned: 0 in 0.629s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:32 devstack cinder-volume[87096]: WARNING cinder.db.api [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1228364844'] Sep 28 18:05:32 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64 Sep 28 18:05:32 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:32 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Created reservations ['68bc7598-15d9-43dd-8228-59d918c0ccf4', '60a40297-d06a-4ecf-b439-4b3ac1cd2242', 'bd7c1efc-c1e3-4037-a5df-7e5c22b9fdd1', 'b000475b-ac8b-4d84-be7e-fae3abd395ac'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:33 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:05:33 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:33 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4.b6411a5c-f945-435e-b85a-a46659b0ad64" returned: 0 in 0.423s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Flow 'volume_create_manager' (cdde610a-c448-4ecb-a76c-1170f982f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc30f0d-541d-4f0d-ae2d-5f26443af4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-b6411a5c-f945-435e-b85a-a46659b0ad64" released by "_delete_snapshot" :: held 2.670s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc30f0d-541d-4f0d-ae2d-5f26443af4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-20595823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756d6511-857f-44b8-babd-3656a19c3dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b7dde9549147ef8973b36707a21129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:33Z,use_quota=True,user_id='b2517dbb3b7f41a581e558035336650d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:33 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70124e3e-010c-42f7-ac7a-0cae0c02b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70124e3e-010c-42f7-ac7a-0cae0c02b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807b02e1-4ef1-4fe1-a0f1-b5cfa808b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-64f6ab49-b320-4916-811c-9a9e88ab33d4" released by "delete_snapshot" :: held 2.789s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.588s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-df1f7f06-68a0-4fa5-83b6-114ba4b5193b tempest-GroupSnapshotsTest-773219606 None] Delete group completed successfully. Sep 28 18:05:33 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['313ccfa3-728f-46c9-bda4-c76594dd49f7', '437cdf7e-714c-4b92-a075-35986f173f8b', 'fdfe9f09-a11d-4733-9953-e0daaa9f3640', '16a4641b-10e9-4c12-976b-a0be3e0d03cb'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Delete snapshot completed successfully. Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e5df9b75-2728-4835-9fdf-6655b5277825 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-b6411a5c-f945-435e-b85a-a46659b0ad64-delete_snapshot" released by "delete_snapshot" :: held 3.199s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-10b02ea4-c0cd-4641-a711-25231abfdc8d tempest-GroupSnapshotsTest-773219606 None] Group tempest-GroupSnapshotsTest-Group-266379028: creating Sep 28 18:05:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-10b02ea4-c0cd-4641-a711-25231abfdc8d tempest-GroupSnapshotsTest-773219606 None] Group tempest-GroupSnapshotsTest-Group-266379028: created successfully Sep 28 18:05:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-10b02ea4-c0cd-4641-a711-25231abfdc8d tempest-GroupSnapshotsTest-773219606 None] Create group completed successfully. Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807b02e1-4ef1-4fe1-a0f1-b5cfa808b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '756d6511-857f-44b8-babd-3656a19c3dfc', 'volume_name': 'volume-756d6511-857f-44b8-babd-3656a19c3dfc', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee56d2c5-4bc1-489b-adf9-fe0133da797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee56d2c5-4bc1-489b-adf9-fe0133da797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ad96e1-745c-427f-bdd4-47f88a34ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Volume 756d6511-857f-44b8-babd-3656a19c3dfc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-756d6511-857f-44b8-babd-3656a19c3dfc', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Trying to clone 756d6511-857f-44b8-babd-3656a19c3dfc from image fadc8935-e87d-4b36-9885-050bf1046672 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:05:34 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:05:34 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61fd721-2112-44ad-9628-b20649f23a40]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:35 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD Sep 28 18:05:35 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (5d8d3b15-8c1e-4ae3-99d2-ff44464460c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7c896e-605b-4ecb-b833-803708d50685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7c896e-605b-4ecb-b833-803708d50685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-342727301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5395b31-8e49-43c9-962a-22ee1916caa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:35Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dba115c-3ce9-429b-beab-01483bc71a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dba115c-3ce9-429b-beab-01483bc71a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171899a9-8b5a-4389-8fe3-fab2c24d4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171899a9-8b5a-4389-8fe3-fab2c24d4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5395b31-8e49-43c9-962a-22ee1916caa0', 'volume_name': 'volume-b5395b31-8e49-43c9-962a-22ee1916caa0', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2286b2f-5dd1-46e9-806e-785dbac73818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2286b2f-5dd1-46e9-806e-785dbac73818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780434e1-cf0c-4c9f-ae0a-23859737c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume b5395b31-8e49-43c9-962a-22ee1916caa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5395b31-8e49-43c9-962a-22ee1916caa0', 'volume_size': 1} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-342727301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5395b31-8e49-43c9-962a-22ee1916caa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:35Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating volume b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:35 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:35 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 1073741824 Sep 28 18:05:35 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:35 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 is fetched for user b2517dbb3b7f41a581e558035336650d. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ab2e5-1f9f-4d97-8559-5390e3825a59]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:35 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD Sep 28 18:05:35 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:36 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD" returned: 0 in 0.600s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:36 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 1073741824" returned: 0 in 0.829s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:36 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 Sep 28 18:05:36 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (c118a921-4a84-43d1-a9ad-6f917a3ddfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664be194-e7b7-47e4-b466-667512cd9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664be194-e7b7-47e4-b466-667512cd9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763561753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e544db9f-8091-480a-b4ac-2a7c9aa5fd14,host='devstack@QuobyteHD#QuobyteHD',id=74ac2ef4-33a4-4937-9e23-f58826fe190d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:36Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84934a0c-04a1-40d1-b47e-9d410d0d3af8),volume_type_id=84934a0c-04a1-40d1-b47e-9d410d0d3af8)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c7505a-b321-4428-8dcb-29b082d23c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c7505a-b321-4428-8dcb-29b082d23c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f7ffa3-1474-4729-b2a2-496d74ab3443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f7ffa3-1474-4729-b2a2-496d74ab3443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ac2ef4-33a4-4937-9e23-f58826fe190d', 'volume_name': 'volume-74ac2ef4-33a4-4937-9e23-f58826fe190d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72c9447-1c1a-4236-bf77-5e05d693a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72c9447-1c1a-4236-bf77-5e05d693a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3532eac-4120-461c-813a-e280ced585f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Volume 74ac2ef4-33a4-4937-9e23-f58826fe190d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ac2ef4-33a4-4937-9e23-f58826fe190d', 'volume_size': 1} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:36 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0" returned: 0 in 0.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-20595823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756d6511-857f-44b8-babd-3656a19c3dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b7dde9549147ef8973b36707a21129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:33Z,use_quota=True,user_id='b2517dbb3b7f41a581e558035336650d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Creating volume 756d6511-857f-44b8-babd-3656a19c3dfc {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:36 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:36 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc 1073741824 Sep 28 18:05:36 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780434e1-cf0c-4c9f-ae0a-23859737c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5395b31-8e49-43c9-962a-22ee1916caa0', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cf5326-7d60-4872-8a29-11ab955ffb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume volume-b5395b31-8e49-43c9-962a-22ee1916caa0 (b5395b31-8e49-43c9-962a-22ee1916caa0): created successfully Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cf5326-7d60-4872-8a29-11ab955ffb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (5d8d3b15-8c1e-4ae3-99d2-ff44464460c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-edf795e7-472e-419e-a5c6-361961610903 tempest-VolumesSnapshotTestJSON-1251967255 None] Created volume successfully. Sep 28 18:05:37 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc 1073741824" returned: 0 in 0.571s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:37 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc Sep 28 18:05:37 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:37 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc" returned: 0 in 0.384s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e544db9f-8091-480a-b4ac-2a7c9aa5fd14,created_at=2026-09-28T16:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763561753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e544db9f-8091-480a-b4ac-2a7c9aa5fd14,host='devstack@QuobyteHD#QuobyteHD',id=74ac2ef4-33a4-4937-9e23-f58826fe190d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:36Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84934a0c-04a1-40d1-b47e-9d410d0d3af8),volume_type_id=84934a0c-04a1-40d1-b47e-9d410d0d3af8)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Creating volume 74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:37 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d 1073741824 Sep 28 18:05:37 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Attempting download of fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume 756d6511-857f-44b8-babd-3656a19c3dfc. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69fe56e-da75-4bea-b998-65d7146e685a]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:37 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum Sep 28 18:05:37 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:38 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum" returned: 0 in 0.420s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:38 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d 1073741824" returned: 0 in 0.613s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:38 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d Sep 28 18:05:38 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:38 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum Sep 28 18:05:38 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:38 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum" returned: 1 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_5czgcgum' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:05:38 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[323dcab7-bbf0-492a-b296-80588b0ac64d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.939s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating offline snapshot 4357abf5-5377-4a1d-9671-844b1e508446 of volume b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3532eac-4120-461c-813a-e280ced585f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ac2ef4-33a4-4937-9e23-f58826fe190d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f1c4fe-4f1b-4712-b9bf-7c5c328a2431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb674a1-1c85-43da-b887-b76c1a392353]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:38 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Volume volume-74ac2ef4-33a4-4937-9e23-f58826fe190d (74ac2ef4-33a4-4937-9e23-f58826fe190d): created successfully Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f1c4fe-4f1b-4712-b9bf-7c5c328a2431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:38 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD Sep 28 18:05:38 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (c118a921-4a84-43d1-a9ad-6f917a3ddfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f9e67448-3491-43a6-a815-9200378fa8b8 tempest-GroupSnapshotsTest-773219606 None] Created volume successfully. Sep 28 18:05:38 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 Sep 28 18:05:38 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:39 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] fadc8935-e87d-4b36-9885-050bf1046672 was qcow2, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:39 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc Sep 28 18:05:39 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:39 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0" returned: 0 in 0.444s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:39 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 1G Sep 28 18:05:39 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:39 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 1G" returned: 0 in 0.550s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5395b31-8e49-43c9-962a-22ee1916caa0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:39 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5395b31-8e49-43c9-962a-22ee1916caa0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 Sep 28 18:05:39 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:40 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5395b31-8e49-43c9-962a-22ee1916caa0 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446" returned: 0 in 0.511s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:40 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 is being set with open permissions: ugo+rw Sep 28 18:05:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:40 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 Sep 28 18:05:40 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:40 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446" returned: 0 in 0.462s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:40 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info Sep 28 18:05:40 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:41 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (efce94a6-8077-47a8-901d-3659acf06abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3675491f-bbbd-4c67-83ef-03cbe7b449ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info" returned: 0 in 0.544s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:41 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info is being set with open permissions: ugo+rw Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3675491f-bbbd-4c67-83ef-03cbe7b449ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1195568935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e544db9f-8091-480a-b4ac-2a7c9aa5fd14,host='devstack@QuobyteHD#QuobyteHD',id=5374baf1-7ea3-4595-93c9-adf0723d40ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:41Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84934a0c-04a1-40d1-b47e-9d410d0d3af8),volume_type_id=84934a0c-04a1-40d1-b47e-9d410d0d3af8)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9920256f-9bf4-4bfc-9d72-5f544f4c5b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info Sep 28 18:05:41 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9920256f-9bf4-4bfc-9d72-5f544f4c5b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fa7e77-9bc2-4ccc-8fa8-aba25e4a8dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fa7e77-9bc2-4ccc-8fa8-aba25e4a8dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5374baf1-7ea3-4595-93c9-adf0723d40ca', 'volume_name': 'volume-5374baf1-7ea3-4595-93c9-adf0723d40ca', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb41b7eb-6c78-4780-986f-2aa9e5a8f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb41b7eb-6c78-4780-986f-2aa9e5a8f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c15b7b-23f1-449f-9507-027f2d6e9228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Volume 5374baf1-7ea3-4595-93c9-adf0723d40ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5374baf1-7ea3-4595-93c9-adf0723d40ca', 'volume_size': 1} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:41 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.info" returned: 0 in 0.353s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.303s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e544db9f-8091-480a-b4ac-2a7c9aa5fd14,created_at=2026-09-28T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1195568935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e544db9f-8091-480a-b4ac-2a7c9aa5fd14,host='devstack@QuobyteHD#QuobyteHD',id=5374baf1-7ea3-4595-93c9-adf0723d40ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:41Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84934a0c-04a1-40d1-b47e-9d410d0d3af8),volume_type_id=84934a0c-04a1-40d1-b47e-9d410d0d3af8)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Creating volume 5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:41 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:05:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:41 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca 1073741824 Sep 28 18:05:41 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-120f22c1-fa77-4b4a-b5ab-9b3dbd316fc8 tempest-VolumesSnapshotTestJSON-1251967255 None] Create snapshot completed successfully Sep 28 18:05:42 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc" returned: 0 in 2.997s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_yq9x62l3devstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:05:42 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Converted 112.00 MB image at 37.36 MB/s Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:42 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc 1G Sep 28 18:05:42 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:42 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca 1073741824" returned: 0 in 0.664s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:42 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca Sep 28 18:05:42 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:42 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc 1G" returned: 0 in 0.527s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Downloaded image fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume 756d6511-857f-44b8-babd-3656a19c3dfc successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 for user b2517dbb3b7f41a581e558035336650d is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Marking volume 756d6511-857f-44b8-babd-3656a19c3dfc as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Copying metadata from image fadc8935-e87d-4b36-9885-050bf1046672 to 756d6511-857f-44b8-babd-3656a19c3dfc. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Creating volume glance metadata for volume 756d6511-857f-44b8-babd-3656a19c3dfc backed by image fadc8935-e87d-4b36-9885-050bf1046672 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:05:42 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ad96e1-745c-427f-bdd4-47f88a34ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756d6511-857f-44b8-babd-3656a19c3dfc', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4c3c99-8192-4468-988c-2712b2043d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c15b7b-23f1-449f-9507-027f2d6e9228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5374baf1-7ea3-4595-93c9-adf0723d40ca', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89f04e3-5504-4cb2-a313-fc825b41ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Volume volume-5374baf1-7ea3-4595-93c9-adf0723d40ca (5374baf1-7ea3-4595-93c9-adf0723d40ca): created successfully Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89f04e3-5504-4cb2-a313-fc825b41ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (efce94a6-8077-47a8-901d-3659acf06abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Volume volume-756d6511-857f-44b8-babd-3656a19c3dfc (756d6511-857f-44b8-babd-3656a19c3dfc): created successfully Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4c3c99-8192-4468-988c-2712b2043d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Flow 'volume_create_manager' (cdde610a-c448-4ecb-a76c-1170f982f805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2e128c52-243a-49b2-9a5c-bb1a05c04504 tempest-GroupSnapshotsTest-773219606 None] Created volume successfully. Sep 28 18:05:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-814d8d59-3dcf-4fbd-9970-6e97ef419220 tempest-ServerActionsTestOtherA-297840239 None] Created volume successfully. Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (24817a43-bdb8-48ae-8170-cb2aef43f647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c26255-4f01-439c-9474-54b41f7bc3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c26255-4f01-439c-9474-54b41f7bc3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916254907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430f5f91-8e81-4079-b377-b63fd2cec8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4357abf5-5377-4a1d-9671-844b1e508446,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:43Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588f5919-805e-44e6-acb5-819c3399220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588f5919-805e-44e6-acb5-819c3399220a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356126f7-55ec-4f34-90ac-1a2d0b82e6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356126f7-55ec-4f34-90ac-1a2d0b82e6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '430f5f91-8e81-4079-b377-b63fd2cec8b3', 'volume_name': 'volume-430f5f91-8e81-4079-b377-b63fd2cec8b3', 'volume_size': 2, 'snapshot_id': '4357abf5-5377-4a1d-9671-844b1e508446'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3d909b-30e9-47ce-ab97-6e12ce1fda3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3d909b-30e9-47ce-ab97-6e12ce1fda3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f781c123-1be1-405c-97a7-c3eb2f06e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:43 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume 430f5f91-8e81-4079-b377-b63fd2cec8b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-430f5f91-8e81-4079-b377-b63fd2cec8b3', 'volume_size': 2, 'snapshot_id': '4357abf5-5377-4a1d-9671-844b1e508446'} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-4357abf5-5377-4a1d-9671-844b1e508446-430f5f91-8e81-4079-b377-b63fd2cec8b3" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-4357abf5-5377-4a1d-9671-844b1e508446-430f5f91-8e81-4079-b377-b63fd2cec8b3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating volume 430f5f91-8e81-4079-b377-b63fd2cec8b3 from snapshot 4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-430f5f91-8e81-4079-b377-b63fd2cec8b3" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-430f5f91-8e81-4079-b377-b63fd2cec8b3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] snapshot: 4357abf5-5377-4a1d-9671-844b1e508446, volume: 430f5f91-8e81-4079-b377-b63fd2cec8b3, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396de68-b8d1-43aa-89f2-e2c85317464b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:43 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 Sep 28 18:05:43 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:43 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446" returned: 0 in 0.536s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5395b31-8e49-43c9-962a-22ee1916caa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946a27b-b8cd-4b75-be81-7d77ccdc6770]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:44 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 Sep 28 18:05:44 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-573eb30f-ce20-456a-b96e-af3f1afd3849 tempest-GroupSnapshotsTest-773219606 None] Update group completed successfully. Sep 28 18:05:44 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0" returned: 0 in 0.465s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:05:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:05:44 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:05:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:44 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 Sep 28 18:05:44 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-44e81575-9c87-489c-8831-67b726bd6525 tempest-GroupSnapshotsTest-773219606 None] Update group completed successfully. Sep 28 18:05:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1ae1c7e5-1102-49a8-a71f-83ee78909e03 tempest-GroupSnapshotsTest-773219606 None] Update group completed successfully. Sep 28 18:05:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b6e3c8eb-1c57-444a-b620-ccdaedf00b1f tempest-GroupSnapshotsTest-773219606 None] Update group completed successfully. Sep 28 18:05:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-78f5be85-3aa4-45c3-8798-5c85c6309d05 req-66f4c855-800a-496f-9f69-6091687705f4 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] GroupSnapshot 737ba98a-5fc4-4269-8480-ece54ba36d05: creating. Sep 28 18:05:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Group snapshot 737ba98a-5fc4-4269-8480-ece54ba36d05: creating. {{(pid=87096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:05:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:53 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3" returned: 0 in 9.605s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:53 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0, size 1024.00 MB, duration 9.61 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:05:53 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Converted 1024.00 MB image at 106.60 MB/s Sep 28 18:05:53 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 is being set with open permissions: ugo+rw Sep 28 18:05:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:53 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 Sep 28 18:05:53 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:54 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-430f5f91-8e81-4079-b377-b63fd2cec8b3" released by "_copy_volume_from_snapshot" :: held 11.064s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-4357abf5-5377-4a1d-9671-844b1e508446-430f5f91-8e81-4079-b377-b63fd2cec8b3" released by "_create_volume_from_snapshot" :: held 11.176s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.194s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-78f5be85-3aa4-45c3-8798-5c85c6309d05 req-66f4c855-800a-496f-9f69-6091687705f4 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.613s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-78f5be85-3aa4-45c3-8798-5c85c6309d05 req-66f4c855-800a-496f-9f69-6091687705f4 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.239s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f781c123-1be1-405c-97a7-c3eb2f06e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430f5f91-8e81-4079-b377-b63fd2cec8b3', 'volume_size': 2, 'snapshot_id': '4357abf5-5377-4a1d-9671-844b1e508446'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849f1ad5-da45-4dcd-8f80-e6e850de6946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Creating offline snapshot 6d8d12b1-0de6-42d9-89fa-a000086d54bd of volume 74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Volume volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 (430f5f91-8e81-4079-b377-b63fd2cec8b3): created successfully Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849f1ad5-da45-4dcd-8f80-e6e850de6946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (24817a43-bdb8-48ae-8170-cb2aef43f647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3e464-a2a7-46e3-af6e-4d04b010c809]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-78f5be85-3aa4-45c3-8798-5c85c6309d05 req-66f4c855-800a-496f-9f69-6091687705f4 tempest-ServerActionsTestOtherA-297840239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-756d6511-857f-44b8-babd-3656a19c3dfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d8f7768-1684-4b98-a88e-5983305887e6', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:05:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5db94110-8a4c-41a1-86de-958bbd994da3 tempest-VolumesSnapshotTestJSON-1251967255 None] Created volume successfully. Sep 28 18:05:54 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d Sep 28 18:05:54 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-78f5be85-3aa4-45c3-8798-5c85c6309d05 req-66f4c855-800a-496f-9f69-6091687705f4 tempest-ServerActionsTestOtherA-297840239 None] attachment_update completed successfully. Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-430f5f91-8e81-4079-b377-b63fd2cec8b3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-430f5f91-8e81-4079-b377-b63fd2cec8b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-430f5f91-8e81-4079-b377-b63fd2cec8b3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-430f5f91-8e81-4079-b377-b63fd2cec8b3" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8238335e-08cb-4dd2-9d38-659856c7578d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:55 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d" returned: 0 in 0.710s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:55 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd 1G Sep 28 18:05:55 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:55 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 Sep 28 18:05:55 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:55 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3" returned: 0 in 0.704s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:55 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3 Sep 28 18:05:55 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:56 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd 1G" returned: 0 in 0.944s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ac2ef4-33a4-4937-9e23-f58826fe190d -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:56 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ac2ef4-33a4-4937-9e23-f58826fe190d -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd Sep 28 18:05:56 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:56 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-430f5f91-8e81-4079-b377-b63fd2cec8b3" returned: 0 in 0.560s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-430f5f91-8e81-4079-b377-b63fd2cec8b3" released by "delete_volume" :: held 1.347s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['bcd1b29f-0324-4af9-a98c-e57c1e3e73bd', '52282699-1a7f-4644-8600-5dc53069f94d', '8b27f8a9-178d-4163-9e62-8c4b476c96e5', '03aff140-10d0-4746-9aab-fae65084191e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:56 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ac2ef4-33a4-4937-9e23-f58826fe190d -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd" returned: 0 in 0.703s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:56 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:56 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:05:56 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:56 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd Sep 28 18:05:56 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:57 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd" returned: 0 in 0.597s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.636s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleted volume successfully. Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ea273c06-7722-4143-a5c9-745b13f21f62 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-430f5f91-8e81-4079-b377-b63fd2cec8b3-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:57 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info Sep 28 18:05:57 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-4357abf5-5377-4a1d-9671-844b1e508446-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-4357abf5-5377-4a1d-9671-844b1e508446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-b5395b31-8e49-43c9-962a-22ee1916caa0" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-b5395b31-8e49-43c9-962a-22ee1916caa0" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-4357abf5-5377-4a1d-9671-844b1e508446" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-4357abf5-5377-4a1d-9671-844b1e508446" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Deleting offline snapshot 4357abf5-5377-4a1d-9671-844b1e508446 of volume b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] snapshot_file for this snap is: volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727ea2f-57d5-489a-aed1-06688ad0c2f3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:58 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info" returned: 0 in 0.583s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:58 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:05:58 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:58 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:58 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info Sep 28 18:05:58 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:58 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.info" returned: 0 in 0.319s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.088s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Creating offline snapshot a24980ba-7b02-47c0-bb2f-829b6a7f3d2e of volume 5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:05:58 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446" returned: 0 in 0.628s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5395b31-8e49-43c9-962a-22ee1916caa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1204f561-20fe-4895-8ac2-33de0a7de7df]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d05f3c8-e1b1-4658-b047-eee384426e00]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:58 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca Sep 28 18:05:58 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:58 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 Sep 28 18:05:58 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:59 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca" returned: 0 in 0.670s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e 1G Sep 28 18:05:59 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:59 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0" returned: 0 in 1.223s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:59 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 Sep 28 18:05:59 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e 1G" returned: 0 in 0.851s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5374baf1-7ea3-4595-93c9-adf0723d40ca -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5374baf1-7ea3-4595-93c9-adf0723d40ca -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e Sep 28 18:06:00 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446" returned: 0 in 0.698s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446 Sep 28 18:06:00 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5374baf1-7ea3-4595-93c9-adf0723d40ca -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" returned: 0 in 0.845s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:01 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e Sep 28 18:06:01 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0.4357abf5-5377-4a1d-9671-844b1e508446" returned: 0 in 0.557s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-4357abf5-5377-4a1d-9671-844b1e508446" released by "_delete_snapshot" :: held 3.333s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-b5395b31-8e49-43c9-962a-22ee1916caa0" released by "delete_snapshot" :: held 3.378s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['dd4cf973-5f0f-4d09-a4be-bb8a7940f252', 'eee55a01-8319-4f40-874f-bac9ae141268', '48b79c4c-8817-405d-a754-65debe76aa78', '81801443-ac18-4905-9290-efd0b27621ca'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:01 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" returned: 0 in 0.406s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Delete snapshot completed successfully. Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa574d36-2b2c-4321-bfc8-b5725964bdcf tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-4357abf5-5377-4a1d-9671-844b1e508446-delete_snapshot" released by "delete_snapshot" :: held 3.691s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:01 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info Sep 28 18:06:01 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info" returned: 0 in 0.342s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:01 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info Sep 28 18:06:01 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:02 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.info" returned: 0 in 0.389s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.782s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-b5395b31-8e49-43c9-962a-22ee1916caa0-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-b5395b31-8e49-43c9-962a-22ee1916caa0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-84805576-7684-4e22-951f-f5c9707c76c0 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 737ba98a-5fc4-4269-8480-ece54ba36d05: created successfully Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-b5395b31-8e49-43c9-962a-22ee1916caa0" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-b5395b31-8e49-43c9-962a-22ee1916caa0" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[29972cd8-fd78-4b3f-9014-bc3f8cf96cf0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:02 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 Sep 28 18:06:02 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:03 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 737ba98a-5fc4-4269-8480-ece54ba36d05: deleting Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 737ba98a-5fc4-4269-8480-ece54ba36d05: deleting {{(pid=87096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-74ac2ef4-33a4-4937-9e23-f58826fe190d" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-74ac2ef4-33a4-4937-9e23-f58826fe190d" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-6d8d12b1-0de6-42d9-89fa-a000086d54bd" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-6d8d12b1-0de6-42d9-89fa-a000086d54bd" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Deleting offline snapshot 6d8d12b1-0de6-42d9-89fa-a000086d54bd of volume 74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] snapshot_file for this snap is: volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85bb670-bc77-4883-937a-e899ee3bdfb0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:03 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0" returned: 0 in 1.111s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:03 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0 Sep 28 18:06:03 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd Sep 28 18:06:04 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5395b31-8e49-43c9-962a-22ee1916caa0" returned: 0 in 0.665s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd" returned: 0 in 0.848s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74ac2ef4-33a4-4937-9e23-f58826fe190d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-b5395b31-8e49-43c9-962a-22ee1916caa0" released by "delete_volume" :: held 1.999s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0bb7cb-f0e7-4266-a9f4-a46a40beba1f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:04 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['bdc7f6c5-97a2-4ecc-a212-148da5cffbe8', '098738ac-25bd-4c3d-b445-591541b36545', '64dda97f-659c-4a99-a1a7-68e6772dab04', '6e6f006e-b70b-4643-9de2-62fc4f5a068d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:05 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d Sep 28 18:06:05 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:05 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:05 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d" returned: 0 in 0.797s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:05 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd Sep 28 18:06:05 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.487s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleted volume successfully. Sep 28 18:06:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97b7732b-1d06-4f58-b183-aea3abbacf03 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-b5395b31-8e49-43c9-962a-22ee1916caa0-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:06 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd" returned: 0 in 0.779s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:06 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd Sep 28 18:06:06 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:06 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d.6d8d12b1-0de6-42d9-89fa-a000086d54bd" returned: 0 in 0.510s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-6d8d12b1-0de6-42d9-89fa-a000086d54bd" released by "_delete_snapshot" :: held 3.263s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-74ac2ef4-33a4-4937-9e23-f58826fe190d" released by "delete_snapshot" :: held 3.347s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-5374baf1-7ea3-4595-93c9-adf0723d40ca" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-5374baf1-7ea3-4595-93c9-adf0723d40ca" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Deleting offline snapshot a24980ba-7b02-47c0-bb2f-829b6a7f3d2e of volume 5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] snapshot_file for this snap is: volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[132ac35a-b3c0-40d9-b4e2-1ed0d8433db4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:07 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e Sep 28 18:06:07 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (188a25cd-0c7d-434a-a5f5-c06e6272f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9ce45b-dc78-4101-91eb-4b9753935a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9ce45b-dc78-4101-91eb-4b9753935a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1449490808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d05a33e-6d2b-4f89-9976-30f2866a078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:07Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59760a95-e87f-4960-ba32-2e20378a1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59760a95-e87f-4960-ba32-2e20378a1a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e07aef4-0585-42d6-b9a8-f39537f055b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e07aef4-0585-42d6-b9a8-f39537f055b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d05a33e-6d2b-4f89-9976-30f2866a078f', 'volume_name': 'volume-8d05a33e-6d2b-4f89-9976-30f2866a078f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8405c08f-62e7-4d5e-9d60-48e5cafda719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8405c08f-62e7-4d5e-9d60-48e5cafda719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec75ffe-7dcf-414c-ae95-1e18bf32a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:07 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Volume 8d05a33e-6d2b-4f89-9976-30f2866a078f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d05a33e-6d2b-4f89-9976-30f2866a078f', 'volume_size': 1} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1449490808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d05a33e-6d2b-4f89-9976-30f2866a078f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:07Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Creating volume 8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:07 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:07 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f 1073741824 Sep 28 18:06:07 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:07 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" returned: 0 in 0.861s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5374baf1-7ea3-4595-93c9-adf0723d40ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13f09e2-c940-4c7c-be81-00fd1956e2b1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:08 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca Sep 28 18:06:08 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:08 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f 1073741824" returned: 0 in 0.967s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:08 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca" returned: 0 in 0.696s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:08 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e Sep 28 18:06:08 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:08 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f Sep 28 18:06:08 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:09 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f" returned: 0 in 0.563s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec75ffe-7dcf-414c-ae95-1e18bf32a007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d05a33e-6d2b-4f89-9976-30f2866a078f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bd9e1a-6ffd-43ae-87f5-01b13d84272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Volume volume-8d05a33e-6d2b-4f89-9976-30f2866a078f (8d05a33e-6d2b-4f89-9976-30f2866a078f): created successfully Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bd9e1a-6ffd-43ae-87f5-01b13d84272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (188a25cd-0c7d-434a-a5f5-c06e6272f14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ed3e43bc-c161-4d03-9b2f-1b323038debd tempest-VolumesSnapshotTestJSON-1251967255 None] Created volume successfully. Sep 28 18:06:09 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" returned: 0 in 0.831s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:09 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e Sep 28 18:06:09 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:10 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca.a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" returned: 0 in 0.787s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-a24980ba-7b02-47c0-bb2f-829b6a7f3d2e" released by "_delete_snapshot" :: held 3.415s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Creating offline snapshot e10a2c2b-576f-4c18-b48d-afc769aa5c8e of volume 8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-5374baf1-7ea3-4595-93c9-adf0723d40ca" released by "delete_snapshot" :: held 3.483s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d7cc81-5c11-4b5c-9302-b180fe7866b7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:10 devstack cinder-volume[87096]: WARNING cinder.quota [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-598529871 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-598529871, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:10 devstack cinder-volume[87096]: WARNING cinder.quota [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-598529871 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-598529871, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:10 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['e042ae6f-6d6c-42ec-b1ab-cc7604b40fdd', '7e4d09c2-5985-40a9-824b-64b0b7ec3541', 'cf74e07f-788d-48b0-9629-77cd443ffb5a', '5ce631e4-ef32-4c59-9f28-3cb5816c16f0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:10 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f Sep 28 18:06:10 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:11 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['81cac12e-fd2c-4b1c-b0a1-4ec8a62848e6', '3eccd616-9f1c-4612-afec-01861a71a382', '621c54eb-7071-45f4-be54-5c3c397969f9', '16e4d153-06bb-4ab9-8abe-27bcf79b9e3f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-53c449a4-8cff-4808-9878-dc0478f37d23 tempest-GroupSnapshotsTest-773219606 None] group_snapshot 737ba98a-5fc4-4269-8480-ece54ba36d05: deleted successfully Sep 28 18:06:11 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f" returned: 0 in 1.030s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:11 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e 1G Sep 28 18:06:11 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:12 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e 1G" returned: 0 in 0.851s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d05a33e-6d2b-4f89-9976-30f2866a078f -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:12 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d05a33e-6d2b-4f89-9976-30f2866a078f -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e Sep 28 18:06:12 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-5374baf1-7ea3-4595-93c9-adf0723d40ca" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-5374baf1-7ea3-4595-93c9-adf0723d40ca" acquired by "delete_volume" :: waited 0.069s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[79600888-ad88-408e-965f-ccfbf8f00f20]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d05a33e-6d2b-4f89-9976-30f2866a078f -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e" returned: 0 in 0.924s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:13 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e is being set with open permissions: ugo+rw Sep 28 18:06:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:13 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e Sep 28 18:06:13 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:13 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca Sep 28 18:06:13 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e" returned: 0 in 0.699s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca" returned: 0 in 0.879s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info Sep 28 18:06:14 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:14 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5374baf1-7ea3-4595-93c9-adf0723d40ca" returned: 0 in 0.814s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info" returned: 0 in 0.754s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:14 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info is being set with open permissions: ugo+rw Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-5374baf1-7ea3-4595-93c9-adf0723d40ca" released by "delete_volume" :: held 1.906s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-74ac2ef4-33a4-4937-9e23-f58826fe190d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:14 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info Sep 28 18:06:14 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-74ac2ef4-33a4-4937-9e23-f58826fe190d" acquired by "delete_volume" :: waited 0.061s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b1b1bd-9260-4934-9a6c-d7cc4d21a528]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.info" returned: 0 in 0.336s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.904s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:15 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d Sep 28 18:06:15 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-06d760e6-fdbe-4cf9-891e-e87dbdec2129 tempest-VolumesSnapshotTestJSON-1251967255 None] Create snapshot completed successfully Sep 28 18:06:15 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d" returned: 0 in 0.804s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:15 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d Sep 28 18:06:15 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-029236e6-2172-41ec-b600-ef77afa1ef63 tempest-ServerActionsTestOtherA-297840239 None] Terminate volume connection completed successfully. Sep 28 18:06:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-029236e6-2172-41ec-b600-ef77afa1ef63 tempest-ServerActionsTestOtherA-297840239 None] Deleting attachment 6d8f7768-1684-4b98-a88e-5983305887e6. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:06:16 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-74ac2ef4-33a4-4937-9e23-f58826fe190d" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-74ac2ef4-33a4-4937-9e23-f58826fe190d" released by "delete_volume" :: held 1.522s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:16 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['30d7cc80-a6a8-4b0a-83f6-d688aad2992a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:16 devstack cinder-volume[87096]: WARNING cinder.quota [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-598529871 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-598529871, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:16 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['3ef4cf5e-4a68-465a-b701-9d0e2da5bd05', '01e6620e-2d32-4ef4-80e1-b119376cc1bb', '849da34c-a09c-4d25-a541-4890fa8f99f6', 'bcbd964d-182a-4d57-8dac-c8eb193edbdf'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (57a6be31-2945-41e3-8dd0-266d735cf053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf94ec0c-236e-494e-9ca1-14c41c7072a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf94ec0c-236e-494e-9ca1-14c41c7072a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-9477392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985b5ab9c03d472bbf6cbb4f8d1a9ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e10a2c2b-576f-4c18-b48d-afc769aa5c8e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:17Z,use_quota=True,user_id='ef3908b744a743358ff61f580f04e597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd276a4-33d2-4903-aaf4-84d583f879ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd276a4-33d2-4903-aaf4-84d583f879ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0946b67c-7955-45df-8671-b2d290c484d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0946b67c-7955-45df-8671-b2d290c484d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4', 'volume_name': 'volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4', 'volume_size': 1, 'snapshot_id': 'e10a2c2b-576f-4c18-b48d-afc769aa5c8e'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f7a087-5047-4a2e-b771-34f492d06acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f7a087-5047-4a2e-b771-34f492d06acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb1931-d08a-4f7b-a255-a063680b361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:17 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Volume db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4', 'volume_size': 1, 'snapshot_id': 'e10a2c2b-576f-4c18-b48d-afc769aa5c8e'} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-e10a2c2b-576f-4c18-b48d-afc769aa5c8e-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-e10a2c2b-576f-4c18-b48d-afc769aa5c8e-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Creating volume db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 from snapshot e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] snapshot: e10a2c2b-576f-4c18-b48d-afc769aa5c8e, volume: db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['35c67a83-8072-465f-ae54-f1d70749de97', 'efdf90e1-a6e1-436c-bbfd-639ea20f27ee', '81fbde66-075a-4da0-8ae9-5f8e0e115a5f', 'd0e4eb17-938f-4954-9036-068f45d9d464'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[be702a4a-a072-4308-aeb4-7ed135d9678d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e Sep 28 18:06:17 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:17 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:17 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e" returned: 0 in 0.567s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d05a33e-6d2b-4f89-9976-30f2866a078f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de04172-a7c6-4243-8d18-a860a5abd104]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:17 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.422s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:17 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-61ac2f07-beca-4f0d-b3b7-759ffd1fdf00 tempest-GroupSnapshotsTest-773219606 None] Delete group completed successfully. Sep 28 18:06:18 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f Sep 28 18:06:18 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-7a95e347-4645-4d16-8844-4bb119caf791 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:18 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f" returned: 0 in 0.677s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:06:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:06:18 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:06:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:18 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 Sep 28 18:06:18 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bfabfa59-fb06-4eb7-bb93-df7cd23d55fd tempest-GroupSnapshotsTest-773219606 None] Group tempest-GroupSnapshotsTest-Group-1765963264: creating Sep 28 18:06:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bfabfa59-fb06-4eb7-bb93-df7cd23d55fd tempest-GroupSnapshotsTest-773219606 None] Group tempest-GroupSnapshotsTest-Group-1765963264: created successfully Sep 28 18:06:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bfabfa59-fb06-4eb7-bb93-df7cd23d55fd tempest-GroupSnapshotsTest-773219606 None] Create group completed successfully. Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=129,cinder:SELECT=147,cinder:INSERT=34,cinder:DELETE=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=140,cinder:INSERT=39,cinder:UPDATE=126,cinder:DELETE=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (6fd46d19-a36c-4a65-8728-2aac7d194c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18374a50-64a0-458b-bfe3-a83016388c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18374a50-64a0-458b-bfe3-a83016388c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524903439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc2cd70b-f113-4aca-bd16-893efbe90c39,host='devstack@QuobyteHD#QuobyteHD',id=715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:22Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be40b018-0856-4630-bdea-22bea0c9fa5c),volume_type_id=be40b018-0856-4630-bdea-22bea0c9fa5c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b8bc85-d2c3-43fd-ade0-e5a13ed288aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b8bc85-d2c3-43fd-ade0-e5a13ed288aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41e78e0-da88-4e2b-8852-25f7df81d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41e78e0-da88-4e2b-8852-25f7df81d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e', 'volume_name': 'volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea07a2d0-4fd4-4088-8286-18ecf4d75e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea07a2d0-4fd4-4088-8286-18ecf4d75e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70447f4-4898-4290-a8c5-68e4664d07f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:22 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Volume 715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e', 'volume_size': 1} Sep 28 18:06:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:23 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:23 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:24 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.900s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:06:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:06:27 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (fa48f330-9b61-45d2-846b-ca967e85df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77895d28-e6f3-4229-9907-2ca53cee73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77895d28-e6f3-4229-9907-2ca53cee73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-715372793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb13291-01b6-43d3-9e66-6266d7beee95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:28Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4803d4-cb47-4366-9f06-efa032fc2ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4803d4-cb47-4366-9f06-efa032fc2ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ae30a6-6d76-4d95-bd86-209596455dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ae30a6-6d76-4d95-bd86-209596455dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb13291-01b6-43d3-9e66-6266d7beee95', 'volume_name': 'volume-ffb13291-01b6-43d3-9e66-6266d7beee95', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f153017-37fb-46b0-b610-724fb9cdd88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f153017-37fb-46b0-b610-724fb9cdd88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac055bb5-5afe-4674-a37d-e73a8b73a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Volume ffb13291-01b6-43d3-9e66-6266d7beee95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb13291-01b6-43d3-9e66-6266d7beee95', 'volume_size': 1} Sep 28 18:06:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:29 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" returned: 0 in 10.918s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f, size 1024.00 MB, duration 10.92 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:06:29 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Converted 1024.00 MB image at 93.78 MB/s Sep 28 18:06:29 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 is being set with open permissions: ugo+rw Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:29 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 Sep 28 18:06:29 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:29 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" returned: 0 in 0.289s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" released by "_copy_volume_from_snapshot" :: held 12.593s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-e10a2c2b-576f-4c18-b48d-afc769aa5c8e-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" released by "_create_volume_from_snapshot" :: held 12.690s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.719s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-7a95e347-4645-4d16-8844-4bb119caf791 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.354s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-7a95e347-4645-4d16-8844-4bb119caf791 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.342s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fc2cd70b-f113-4aca-bd16-893efbe90c39,created_at=2026-09-28T16:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524903439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fc2cd70b-f113-4aca-bd16-893efbe90c39,host='devstack@QuobyteHD#QuobyteHD',id=715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90c66216d39d4f3c8eea155b7a014759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:22Z,use_quota=True,user_id='83a24e032f3d4fe39eee1b617f384288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be40b018-0856-4630-bdea-22bea0c9fa5c),volume_type_id=be40b018-0856-4630-bdea-22bea0c9fa5c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Creating volume 715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:29 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb1931-d08a-4f7b-a255-a063680b361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4', 'volume_size': 1, 'snapshot_id': 'e10a2c2b-576f-4c18-b48d-afc769aa5c8e'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87983e6-1ac2-4a0a-8c9e-56ff70d80507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:30 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e 1073741824 Sep 28 18:06:30 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:30 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Volume volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 (db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4): created successfully Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87983e6-1ac2-4a0a-8c9e-56ff70d80507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Flow 'volume_create_manager' (57a6be31-2945-41e3-8dd0-266d735cf053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-7a95e347-4645-4d16-8844-4bb119caf791 tempest-ServerActionsTestOtherA-297840239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-756d6511-857f-44b8-babd-3656a19c3dfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45dd9f1a-c440-4c60-8af0-a52d466f950d', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:06:30 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fe299fcb-4aa5-49db-aca4-f6c3d377f2ea tempest-VolumesSnapshotTestJSON-1251967255 None] Created volume successfully. Sep 28 18:06:30 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-2e7d7659-a54f-4d18-8cd6-79fa65159c9c req-7a95e347-4645-4d16-8844-4bb119caf791 tempest-ServerActionsTestOtherA-297840239 None] attachment_update completed successfully. Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:30 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e 1073741824" returned: 0 in 0.858s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a25184d-b58c-4d61-a527-56adbc872710]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:30 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e Sep 28 18:06:30 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:31 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 Sep 28 18:06:31 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:31 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.277s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-715372793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb13291-01b6-43d3-9e66-6266d7beee95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:28Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Creating volume ffb13291-01b6-43d3-9e66-6266d7beee95 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:31 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70447f4-4898-4290-a8c5-68e4664d07f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ba095a-a219-4cc5-aa94-68597d364d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:31 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 1073741824 Sep 28 18:06:31 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:31 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Volume volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e (715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e): created successfully Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ba095a-a219-4cc5-aa94-68597d364d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Flow 'volume_create_manager' (6fd46d19-a36c-4a65-8728-2aac7d194c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:31 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-83201dc2-306f-4eba-8a4c-dea2de07cbae tempest-GroupSnapshotsTest-773219606 None] Created volume successfully. Sep 28 18:06:32 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" returned: 0 in 1.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:32 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4 Sep 28 18:06:32 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:32 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 1073741824" returned: 0 in 1.259s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] GroupSnapshot c2ad9bc1-1d04-4d4a-a3f8-da95017b3899: creating. Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:32 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" returned: 0 in 0.672s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4" released by "delete_volume" :: held 2.095s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Group snapshot c2ad9bc1-1d04-4d4a-a3f8-da95017b3899: creating. {{(pid=87096) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:06:32 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 Sep 28 18:06:32 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['fbfa5f75-2f92-4445-8536-9c18612db210', 'd4a12130-8af9-458c-8a19-1d47b247e9e8', 'e7890f89-e04a-48b1-b99e-ecb1d393c717', 'b04193e9-2680-4166-9ec2-9d088404fbc7'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:33 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:33 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-e10a2c2b-576f-4c18-b48d-afc769aa5c8e-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-e10a2c2b-576f-4c18-b48d-afc769aa5c8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-8d05a33e-6d2b-4f89-9976-30f2866a078f" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-8d05a33e-6d2b-4f89-9976-30f2866a078f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-e10a2c2b-576f-4c18-b48d-afc769aa5c8e" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:33 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95" returned: 0 in 0.701s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-e10a2c2b-576f-4c18-b48d-afc769aa5c8e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleting offline snapshot e10a2c2b-576f-4c18-b48d-afc769aa5c8e of volume 8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] snapshot_file for this snap is: volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.678s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f679dd5-c0e7-4826-8d5f-4684564cd7ad]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Creating offline snapshot 9f207faf-9d1b-400a-8566-fb9c11a8da75 of volume 715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac055bb5-5afe-4674-a37d-e73a8b73a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb13291-01b6-43d3-9e66-6266d7beee95', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:33 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1984b9cf-8102-433d-b25f-891588475a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.528s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleted volume successfully. Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[972aa078-7582-478f-954d-5d5b0e1b6833]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Volume volume-ffb13291-01b6-43d3-9e66-6266d7beee95 (ffb13291-01b6-43d3-9e66-6266d7beee95): created successfully Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1984b9cf-8102-433d-b25f-891588475a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (fa48f330-9b61-45d2-846b-ca967e85df1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:33 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e Sep 28 18:06:33 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6b2c2631-b282-428e-9a89-74eb0a0c496e tempest-VolumesActionsTest-684823865 None] Created volume successfully. Sep 28 18:06:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7ca861df-0737-4e88-85d0-894d3f7625d6 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-db0b1a1e-9c21-4011-a9f6-b8b3d66a04a4-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:34 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e Sep 28 18:06:34 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79a54e63-40c6-4046-ae6c-7e94f157faba tempest-VolumesActionsTest-684823865 None] Acquiring lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95" by "attach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79a54e63-40c6-4046-ae6c-7e94f157faba tempest-VolumesActionsTest-684823865 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95" acquired by "attach_volume" :: waited 0.039s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-79a54e63-40c6-4046-ae6c-7e94f157faba tempest-VolumesActionsTest-684823865 None] Attaching volume ffb13291-01b6-43d3-9e66-6266d7beee95 to instance 63c3fc8c-8805-46d5-b506-9d7643abbb47 at mountpoint /dev/vdb on host None. Sep 28 18:06:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-79a54e63-40c6-4046-ae6c-7e94f157faba tempest-VolumesActionsTest-684823865 None] Attach volume completed successfully. Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79a54e63-40c6-4046-ae6c-7e94f157faba tempest-VolumesActionsTest-684823865 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95" released by "attach_volume" :: held 0.251s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:34 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" returned: 0 in 0.681s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:34 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:34 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 1G Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e" returned: 0 in 0.898s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:34 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d05a33e-6d2b-4f89-9976-30f2866a078f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbba6a7-f8a4-4aed-967e-b6ab741e2674]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:34 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f Sep 28 18:06:34 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:35 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 1G" returned: 0 in 0.948s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:35 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 Sep 28 18:06:35 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:35 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f" returned: 0 in 1.144s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:35 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e Sep 28 18:06:35 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:36 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75" returned: 0 in 0.592s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:36 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:36 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 Sep 28 18:06:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-91c3aadf-46b3-4dbc-a5c8-e1577ccc3a83 tempest-VolumesActionsTest-1230479050 None] Terminate volume connection completed successfully. Sep 28 18:06:36 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-91c3aadf-46b3-4dbc-a5c8-e1577ccc3a83 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-detach_volume" by "detach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-91c3aadf-46b3-4dbc-a5c8-e1577ccc3a83 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-91c3aadf-46b3-4dbc-a5c8-e1577ccc3a83 tempest-VolumesActionsTest-1230479050 None] Detaching volume ffb13291-01b6-43d3-9e66-6266d7beee95 from instance 63c3fc8c-8805-46d5-b506-9d7643abbb47. Sep 28 18:06:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-91c3aadf-46b3-4dbc-a5c8-e1577ccc3a83 tempest-VolumesActionsTest-1230479050 None] Detach volume completed successfully. Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-91c3aadf-46b3-4dbc-a5c8-e1577ccc3a83 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-detach_volume" released by "detach_volume" :: held 0.315s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:37 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e" returned: 0 in 1.198s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:37 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e Sep 28 18:06:37 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:37 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75" returned: 0 in 1.073s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:37 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info Sep 28 18:06:37 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1a6d2c39-4b4e-440b-87ca-abe914bac181 tempest-VolumesActionsTest-684823865 None] Acquiring lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-detach_volume" by "detach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1a6d2c39-4b4e-440b-87ca-abe914bac181 tempest-VolumesActionsTest-684823865 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-detach_volume" acquired by "detach_volume" :: waited 0.082s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1a6d2c39-4b4e-440b-87ca-abe914bac181 tempest-VolumesActionsTest-684823865 None] Volume detach called, but volume not attached. Sep 28 18:06:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1a6d2c39-4b4e-440b-87ca-abe914bac181 tempest-VolumesActionsTest-684823865 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:38 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info" returned: 0 in 0.744s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:38 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:38 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f.e10a2c2b-576f-4c18-b48d-afc769aa5c8e" returned: 0 in 0.981s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:38 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info Sep 28 18:06:38 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-e10a2c2b-576f-4c18-b48d-afc769aa5c8e" released by "_delete_snapshot" :: held 4.582s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-8d05a33e-6d2b-4f89-9976-30f2866a078f" released by "delete_snapshot" :: held 4.637s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['4c00c32d-c96d-45a4-8b67-cac5e8427fcd', '176467b6-78ee-4d07-8d4f-05175d10a5d8', '3da4f69b-b604-40b4-a1ff-7aa8e5c67c81', '6dce3275-698c-4dd7-a268-bb2a086c5e85'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Acquiring lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Acquiring lock "cinder-quobyte-ffb13291-01b6-43d3-9e66-6266d7beee95" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Delete snapshot completed successfully. Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Lock "cinder-quobyte-ffb13291-01b6-43d3-9e66-6266d7beee95" acquired by "delete_volume" :: waited 0.049s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9da8ff6-663c-4a37-b737-36f7f16cc6f3 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-e10a2c2b-576f-4c18-b48d-afc769aa5c8e-delete_snapshot" released by "delete_snapshot" :: held 4.999s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5fb2f-6468-4768-8c06-995a47f90a17]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:38 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 Sep 28 18:06:38 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:38 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.info" returned: 0 in 0.744s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.113s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0d1d7bc0-66ea-44f7-9e80-1e7509c9657d tempest-GroupSnapshotsTest-773219606 None] group_snapshot c2ad9bc1-1d04-4d4a-a3f8-da95017b3899: created successfully Sep 28 18:06:39 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95" returned: 0 in 0.500s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:39 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95 Sep 28 18:06:39 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-8d05a33e-6d2b-4f89-9976-30f2866a078f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-8d05a33e-6d2b-4f89-9976-30f2866a078f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-8d05a33e-6d2b-4f89-9976-30f2866a078f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-8d05a33e-6d2b-4f89-9976-30f2866a078f" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:39 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ffb13291-01b6-43d3-9e66-6266d7beee95" returned: 0 in 0.458s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e5d7c-b5fc-44e9-9990-056f48cc69a4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Lock "cinder-quobyte-ffb13291-01b6-43d3-9e66-6266d7beee95" released by "delete_volume" :: held 1.074s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Created reservations ['a256eed9-eb5d-4241-b69a-2b5e309745db', 'c08aa9ce-b686-4446-aeb0-52e2ec091240', 'ae5a9a9a-f585-4aa8-86c9-fcefa857c98f', '0857d768-610e-4d1e-949c-229034460bbc'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:39 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f Sep 28 18:06:39 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:39 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:39 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] group_snapshot c2ad9bc1-1d04-4d4a-a3f8-da95017b3899: deleting Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] group_snapshot c2ad9bc1-1d04-4d4a-a3f8-da95017b3899: deleting {{(pid=87096) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-9f207faf-9d1b-400a-8566-fb9c11a8da75" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-9f207faf-9d1b-400a-8566-fb9c11a8da75" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Deleting offline snapshot 9f207faf-9d1b-400a-8566-fb9c11a8da75 of volume 715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] snapshot_file for this snap is: volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c548ec61-86ad-423c-ab6b-7cb77bca97da]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:40 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f" returned: 0 in 0.964s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:40 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.621s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:40 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f Sep 28 18:06:40 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Deleted volume successfully. Sep 28 18:06:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a3761d6b-6561-40be-b616-768c12566bac tempest-VolumesActionsTest-684823865 None] Lock "cinder-ffb13291-01b6-43d3-9e66-6266d7beee95-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:40 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 Sep 28 18:06:40 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:40 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8d05a33e-6d2b-4f89-9976-30f2866a078f" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-8d05a33e-6d2b-4f89-9976-30f2866a078f" released by "delete_volume" :: held 1.583s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['a8dacb51-a494-4a56-8e52-aec2dcf44dda', 'fe2373a0-1e28-409e-b4f8-ca13fd1010ea', '9dc21101-9782-427c-a125-85ac744dabfb', 'f1429439-9b4a-438c-b472-ec53211dd1b0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75" returned: 0 in 1.021s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:41 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:41 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf6cb43-da3d-4942-9200-09e4986e17b5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e Sep 28 18:06:41 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:42 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.808s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleted volume successfully. Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f5bf57af-b3f3-4538-a8ee-b67c39b30783 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-8d05a33e-6d2b-4f89-9976-30f2866a078f-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-64f6ab49-b320-4916-811c-9a9e88ab33d4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-64f6ab49-b320-4916-811c-9a9e88ab33d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:42 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" returned: 0 in 1.141s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:42 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 Sep 28 18:06:42 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "cinder-quobyte-64f6ab49-b320-4916-811c-9a9e88ab33d4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-64f6ab49-b320-4916-811c-9a9e88ab33d4" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3bd51d-d622-4bc7-984f-4b785f1abd49]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 Sep 28 18:06:43 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:43 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75" returned: 0 in 0.940s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75 Sep 28 18:06:43 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:43 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4" returned: 0 in 0.799s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4 Sep 28 18:06:43 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:44 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-64f6ab49-b320-4916-811c-9a9e88ab33d4" returned: 0 in 0.533s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-quobyte-64f6ab49-b320-4916-811c-9a9e88ab33d4" released by "delete_volume" :: held 1.542s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Created reservations ['cc847fb2-440c-4bf2-b4fe-8315aa3c4520', '2e9b812d-3fc1-4870-97d3-3b3f546d778c', 'e76df34d-cbe5-4bac-bd3f-5abd0faa4a95', '853c195c-dbbc-4012-bdd2-4514b5a89e5c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:44 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:44 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e.9f207faf-9d1b-400a-8566-fb9c11a8da75" returned: 0 in 1.145s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-9f207faf-9d1b-400a-8566-fb9c11a8da75" released by "_delete_snapshot" :: held 4.552s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" released by "delete_snapshot" :: held 4.641s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:45 devstack cinder-volume[87096]: WARNING cinder.quota [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-405701110 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-405701110, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:45 devstack cinder-volume[87096]: WARNING cinder.quota [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-405701110 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-405701110, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:45 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] Created reservations ['57ad3bf1-d1e1-4b0d-917f-fad8e5912348', '726bd49c-666c-4343-a54c-1f4e31018b2f', 'b8d3be02-c065-4174-a49b-82c7115e0154', 'ec3d5bb4-c4a1-4887-949e-55edf2acc915'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2b5e3abc-2c50-4664-bdd1-a85a24b2cf5d tempest-GroupSnapshotsTest-773219606 None] group_snapshot c2ad9bc1-1d04-4d4a-a3f8-da95017b3899: deleted successfully Sep 28 18:06:45 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.666s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:45 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Deleted volume successfully. Sep 28 18:06:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-926de278-6a1d-4850-a9b6-d79eeebbffc5 tempest-VolumesSnapshotTestJSON-1251967255 None] Lock "cinder-64f6ab49-b320-4916-811c-9a9e88ab33d4-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:46 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (ed4342dd-fa18-46ae-b6da-c23a74951e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed162073-20ff-4e37-bf2b-ba451948845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed162073-20ff-4e37-bf2b-ba451948845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163973035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80926226-85c0-40ff-b242-ec035d4dfa5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:47Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de07390-8a23-44e2-9138-862cd9cba76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de07390-8a23-44e2-9138-862cd9cba76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40b658a-4f61-4f73-b72d-0c0cfaa9a00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40b658a-4f61-4f73-b72d-0c0cfaa9a00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80926226-85c0-40ff-b242-ec035d4dfa5f', 'volume_name': 'volume-80926226-85c0-40ff-b242-ec035d4dfa5f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d677816c-5715-4dba-9a2c-afebcd3f405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d677816c-5715-4dba-9a2c-afebcd3f405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68db37-f6fa-4e91-89ba-977196448cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:47 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Volume 80926226-85c0-40ff-b242-ec035d4dfa5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80926226-85c0-40ff-b242-ec035d4dfa5f', 'volume_size': 1} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-163973035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80926226-85c0-40ff-b242-ec035d4dfa5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:47Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Creating volume 80926226-85c0-40ff-b242-ec035d4dfa5f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:47 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:47 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f 1073741824 Sep 28 18:06:47 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "cinder-quobyte-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" acquired by "delete_volume" :: waited 0.062s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[39623bb8-6408-4e9c-bee7-01f45096c8b6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:47 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e Sep 28 18:06:47 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:48 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f 1073741824" returned: 0 in 0.841s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:48 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f Sep 28 18:06:48 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:48 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" returned: 0 in 0.648s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:48 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e Sep 28 18:06:48 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:48 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" returned: 0 in 0.446s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:48 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f" returned: 0 in 0.541s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Lock "cinder-quobyte-715931b9-bcb9-4edc-9d4a-6a0caf5a3f5e" released by "delete_volume" :: held 1.287s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68db37-f6fa-4e91-89ba-977196448cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80926226-85c0-40ff-b242-ec035d4dfa5f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafc19e9-3ef5-4503-a08c-b0409597d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:48 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Volume volume-80926226-85c0-40ff-b242-ec035d4dfa5f (80926226-85c0-40ff-b242-ec035d4dfa5f): created successfully Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fafc19e9-3ef5-4503-a08c-b0409597d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (ed4342dd-fa18-46ae-b6da-c23a74951e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9b7af316-d84e-4221-a506-1a7718065d69 tempest-VolumesActionsTest-684823865 None] Created volume successfully. Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['07e0fc79-099b-4b76-b954-85b165646ef4'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:48 devstack cinder-volume[87096]: WARNING cinder.quota [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-405701110 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-405701110, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Created reservations ['736c2f39-933d-47bc-b46b-1d7b90dda004', 'dc70a25e-e3b7-46da-afd4-6664d0a43ecd', '136af8e1-6364-4e1b-821d-0eba939765db', '93a46593-39d5-4443-aa6c-2c19ebcfc835'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:49 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:49 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-80926226-85c0-40ff-b242-ec035d4dfa5f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Lock "cinder-80926226-85c0-40ff-b242-ec035d4dfa5f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-quobyte-80926226-85c0-40ff-b242-ec035d4dfa5f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-80926226-85c0-40ff-b242-ec035d4dfa5f" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3102f74-884f-4c39-917d-8bcaf18ee9c2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:49 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.410s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:49 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5d9b822d-afdb-47ae-97d8-92f399186951 tempest-GroupSnapshotsTest-773219606 None] Delete group completed successfully. Sep 28 18:06:49 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f Sep 28 18:06:49 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:49 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f" returned: 0 in 0.473s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:49 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f Sep 28 18:06:49 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:50 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-80926226-85c0-40ff-b242-ec035d4dfa5f" returned: 0 in 0.396s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-80926226-85c0-40ff-b242-ec035d4dfa5f" released by "delete_volume" :: held 0.943s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Created reservations ['49f26150-9347-4ad0-8d85-27f67bfb3337', 'e4e453db-eb44-4fc0-9635-de99f820d274', 'aaed5089-47cb-4b6a-b565-837c27c0038c', '3e2bd43d-d6fe-418a-9cc7-b40f47c7b7be'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:50 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:50 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:50 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.301s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Deleted volume successfully. Sep 28 18:06:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c55e4ff1-d19e-4940-b5af-065d4475a49a tempest-VolumesActionsTest-1230479050 None] Lock "cinder-80926226-85c0-40ff-b242-ec035d4dfa5f-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (71da9a56-7cbb-4e57-a473-ba6794c8fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bc6769-09ec-4aa2-a598-8a425b288b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bc6769-09ec-4aa2-a598-8a425b288b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1621426223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33db0d12-1cae-468e-baba-c8d768c0ec5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:52Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f4fa5a-8dc3-4ed1-bdca-35e11a27a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f4fa5a-8dc3-4ed1-bdca-35e11a27a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e92ad9-94a3-4aa8-8bb8-b47c9842ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e92ad9-94a3-4aa8-8bb8-b47c9842ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33db0d12-1cae-468e-baba-c8d768c0ec5f', 'volume_name': 'volume-33db0d12-1cae-468e-baba-c8d768c0ec5f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d268475f-963a-4077-a6bb-f22d133089af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d268475f-963a-4077-a6bb-f22d133089af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ddde18-5c37-4840-8448-a352b7d31b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Volume 33db0d12-1cae-468e-baba-c8d768c0ec5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33db0d12-1cae-468e-baba-c8d768c0ec5f', 'volume_size': 1} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1621426223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33db0d12-1cae-468e-baba-c8d768c0ec5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:52Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Creating volume 33db0d12-1cae-468e-baba-c8d768c0ec5f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:52 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:06:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:52 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f 1073741824 Sep 28 18:06:52 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:53 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f 1073741824" returned: 0 in 0.762s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:53 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f Sep 28 18:06:53 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:53 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f" returned: 0 in 0.441s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ddde18-5c37-4840-8448-a352b7d31b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33db0d12-1cae-468e-baba-c8d768c0ec5f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16410678-944f-4d61-af57-826e4ad4719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Volume volume-33db0d12-1cae-468e-baba-c8d768c0ec5f (33db0d12-1cae-468e-baba-c8d768c0ec5f): created successfully Sep 28 18:06:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16410678-944f-4d61-af57-826e4ad4719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (71da9a56-7cbb-4e57-a473-ba6794c8fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1ce7f0ac-ed93-43cc-ba56-e7ae5a59f0e0 tempest-VolumesActionsTest-684823865 None] Created volume successfully. Sep 28 18:06:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-33db0d12-1cae-468e-baba-c8d768c0ec5f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Lock "cinder-33db0d12-1cae-468e-baba-c8d768c0ec5f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-quobyte-33db0d12-1cae-468e-baba-c8d768c0ec5f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-33db0d12-1cae-468e-baba-c8d768c0ec5f" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:55 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec140e97-fe21-4e95-952b-5f7e47c04dfb]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:55 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f Sep 28 18:06:55 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:55 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f" returned: 0 in 0.679s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:55 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f Sep 28 18:06:55 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:56 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-33db0d12-1cae-468e-baba-c8d768c0ec5f" returned: 0 in 0.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-33db0d12-1cae-468e-baba-c8d768c0ec5f" released by "delete_volume" :: held 1.179s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Created reservations ['9167ee70-8a80-4f57-bc68-4bd54d621e6a', 'f021d321-6d47-4c63-84f5-6f33aa559b8b', '0c662eee-3114-459a-851f-c49f383a19d5', '9ab07a97-8947-43f0-bebc-20de5a568812'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:56 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:06:56 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:56 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.409s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Deleted volume successfully. Sep 28 18:06:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ae1c4206-a47f-44a0-a5f0-499c7f1ed9cb tempest-VolumesActionsTest-1230479050 None] Lock "cinder-33db0d12-1cae-468e-baba-c8d768c0ec5f-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (b0a12c28-f88d-4185-ad3b-be84fdc6ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82bdd70-b48a-4f82-b2ef-1a432960886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82bdd70-b48a-4f82-b2ef-1a432960886d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264559565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c5318c-7810-4bd1-b530-343e6148d448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:58Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c47af8-f645-4ee2-aa49-da510c74d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c47af8-f645-4ee2-aa49-da510c74d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5e5bb9-ab54-43b7-9f27-d1549a3fa955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff5e5bb9-ab54-43b7-9f27-d1549a3fa955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c5318c-7810-4bd1-b530-343e6148d448', 'volume_name': 'volume-50c5318c-7810-4bd1-b530-343e6148d448', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4be780-8dac-4f4a-9039-53a3f76e77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4be780-8dac-4f4a-9039-53a3f76e77f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b7f90e-8523-448d-96e9-ee2fac9dfd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:58 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Volume 50c5318c-7810-4bd1-b530-343e6148d448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c5318c-7810-4bd1-b530-343e6148d448', 'volume_size': 1} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1264559565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c5318c-7810-4bd1-b530-343e6148d448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:58Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Creating volume 50c5318c-7810-4bd1-b530-343e6148d448 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:58 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:06:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:58 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 1073741824 Sep 28 18:06:58 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:59 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 1073741824" returned: 0 in 0.704s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:59 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 Sep 28 18:06:59 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:59 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448" returned: 0 in 0.289s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b7f90e-8523-448d-96e9-ee2fac9dfd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c5318c-7810-4bd1-b530-343e6148d448', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bb6754-e953-4c15-ba4f-487aa521c10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:59 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Volume volume-50c5318c-7810-4bd1-b530-343e6148d448 (50c5318c-7810-4bd1-b530-343e6148d448): created successfully Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bb6754-e953-4c15-ba4f-487aa521c10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (b0a12c28-f88d-4185-ad3b-be84fdc6ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c8ec7d62-ea17-4c94-bec3-b37c0eff5d66 tempest-VolumesActionsTest-684823865 None] Created volume successfully. Sep 28 18:07:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-50c5318c-7810-4bd1-b530-343e6148d448-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-50c5318c-7810-4bd1-b530-343e6148d448-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-quobyte-50c5318c-7810-4bd1-b530-343e6148d448" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-50c5318c-7810-4bd1-b530-343e6148d448" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:00 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef2f816-91c0-4f1b-a8c7-eb1a290f4af9]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:00 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 Sep 28 18:07:00 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:01 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448" returned: 0 in 0.463s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:01 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448 Sep 28 18:07:01 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:01 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50c5318c-7810-4bd1-b530-343e6148d448" returned: 0 in 0.311s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-50c5318c-7810-4bd1-b530-343e6148d448" released by "delete_volume" :: held 0.833s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Created reservations ['ebffa520-1d12-4da7-abb6-1b4db0e9e00e', '0096f273-5c2a-4472-b7d5-a253b55f7d73', 'fa050008-c869-409d-b587-5f6aac3c3307', '54fd6beb-629f-4b79-a2b8-f1d5db40d0b5'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:01 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:01 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:02 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.325s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:02 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Deleted volume successfully. Sep 28 18:07:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b01846db-bdba-455d-9932-ea436e505a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-50c5318c-7810-4bd1-b530-343e6148d448-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (59583fc0-afd8-42b8-b770-ca8ed830d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cca35c-d6ae-4ff4-966c-234bad8e41ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cca35c-d6ae-4ff4-966c-234bad8e41ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-76187248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66846d2-c6e8-49d0-bab2-6b60238efac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:04Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d27bec2-882d-4f17-aef4-ad1dd33cccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d27bec2-882d-4f17-aef4-ad1dd33cccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca946a1-f5ae-48f7-a3db-f3a0b57ea7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca946a1-f5ae-48f7-a3db-f3a0b57ea7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66846d2-c6e8-49d0-bab2-6b60238efac7', 'volume_name': 'volume-e66846d2-c6e8-49d0-bab2-6b60238efac7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b870510-05b4-45f2-af3a-1b2cf7a56ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b870510-05b4-45f2-af3a-1b2cf7a56ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d419c5ec-5890-483f-a924-7768f5ddc412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:03 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Volume e66846d2-c6e8-49d0-bab2-6b60238efac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66846d2-c6e8-49d0-bab2-6b60238efac7', 'volume_size': 1} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-76187248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66846d2-c6e8-49d0-bab2-6b60238efac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:04Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Creating volume e66846d2-c6e8-49d0-bab2-6b60238efac7 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:03 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:07:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:03 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 1073741824 Sep 28 18:07:03 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:04 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 1073741824" returned: 0 in 0.792s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:04 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 Sep 28 18:07:04 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:05 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7" returned: 0 in 0.388s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d419c5ec-5890-483f-a924-7768f5ddc412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66846d2-c6e8-49d0-bab2-6b60238efac7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71ef5d5-b06c-4f0f-81b4-f5abb636a23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Volume volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 (e66846d2-c6e8-49d0-bab2-6b60238efac7): created successfully Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71ef5d5-b06c-4f0f-81b4-f5abb636a23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (59583fc0-afd8-42b8-b770-ca8ed830d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b41ac660-78c2-449a-8f4c-79c4a3a514c7 tempest-VolumesActionsTest-684823865 None] Created volume successfully. Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-e66846d2-c6e8-49d0-bab2-6b60238efac7-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-e66846d2-c6e8-49d0-bab2-6b60238efac7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "cinder-quobyte-e66846d2-c6e8-49d0-bab2-6b60238efac7" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-e66846d2-c6e8-49d0-bab2-6b60238efac7" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b700282f-e862-45e8-856f-e1859136f15b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:06 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 Sep 28 18:07:06 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:06 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7" returned: 0 in 0.673s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:07 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7 Sep 28 18:07:07 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:07 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e66846d2-c6e8-49d0-bab2-6b60238efac7" returned: 0 in 0.766s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-quobyte-e66846d2-c6e8-49d0-bab2-6b60238efac7" released by "delete_volume" :: held 1.513s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Created reservations ['45058633-79ae-451d-8611-6e2ef0efd460', '83ac3049-c926-474a-832c-54c4b1a4648f', '9fda86d4-48fd-433a-8108-e221d93f2d02', '0d0d26c2-078d-4d70-8dae-c56716cbaba4'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:08 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.355s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Deleted volume successfully. Sep 28 18:07:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f041c513-a0d2-43b9-9867-a1c98d522a81 tempest-VolumesActionsTest-1230479050 None] Lock "cinder-e66846d2-c6e8-49d0-bab2-6b60238efac7-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (534a5831-2f4d-48b0-83d2-354252623d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf8a077-1460-42f9-ade6-175a53715411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf8a077-1460-42f9-ade6-175a53715411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1885505246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea59674-2e51-4f13-9e00-2dc1d57be5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:09Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae798656-2855-479a-84a9-30d6e7d805be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae798656-2855-479a-84a9-30d6e7d805be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1542d9d0-f182-4eb2-a35c-4f39ca5338d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1542d9d0-f182-4eb2-a35c-4f39ca5338d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea59674-2e51-4f13-9e00-2dc1d57be5c3', 'volume_name': 'volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a2243e-9cda-41ca-83c9-033d08ce0198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a2243e-9cda-41ca-83c9-033d08ce0198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b978af-1da2-4939-a34b-9ea0e2817e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Volume dea59674-2e51-4f13-9e00-2dc1d57be5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3', 'volume_size': 1} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1885505246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea59674-2e51-4f13-9e00-2dc1d57be5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a35bd2b51f479299971e7d6fc56c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:09Z,use_quota=True,user_id='8371ec7c3d574b9c924497371a02acf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Creating volume dea59674-2e51-4f13-9e00-2dc1d57be5c3 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:09 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:07:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:09 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 1073741824 Sep 28 18:07:09 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:10 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 1073741824" returned: 0 in 0.730s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:10 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 Sep 28 18:07:10 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:10 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3" returned: 0 in 0.425s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b978af-1da2-4939-a34b-9ea0e2817e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c14ccf9-be75-4743-af3f-ffb28d191dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:10 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Volume volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 (dea59674-2e51-4f13-9e00-2dc1d57be5c3): created successfully Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c14ccf9-be75-4743-af3f-ffb28d191dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Flow 'volume_create_manager' (534a5831-2f4d-48b0-83d2-354252623d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ac7aa8d4-f293-4e21-91a1-19b20834a003 tempest-VolumesActionsTest-684823865 None] Created volume successfully. Sep 28 18:07:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4d507691-0859-45b6-ac11-8dde01df4880 tempest-GroupsV314Test-1231710330 None] Group tempest-GroupsV314Test-Group-497017791: creating Sep 28 18:07:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4d507691-0859-45b6-ac11-8dde01df4880 tempest-GroupsV314Test-1231710330 None] Group tempest-GroupsV314Test-Group-497017791: created successfully Sep 28 18:07:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4d507691-0859-45b6-ac11-8dde01df4880 tempest-GroupsV314Test-1231710330 None] Create group completed successfully. Sep 28 18:07:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Acquiring lock "cinder-dea59674-2e51-4f13-9e00-2dc1d57be5c3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Lock "cinder-dea59674-2e51-4f13-9e00-2dc1d57be5c3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Acquiring lock "cinder-quobyte-dea59674-2e51-4f13-9e00-2dc1d57be5c3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Lock "cinder-quobyte-dea59674-2e51-4f13-9e00-2dc1d57be5c3" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[202801be-0ddd-4f38-8755-4b1473dabb65]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:13 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 Sep 28 18:07:13 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:13 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4c523f8b-5b80-466c-8ab3-8c07f87ce2ff tempest-ServerActionsTestOtherA-297840239 None] Terminate volume connection completed successfully. Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4c523f8b-5b80-466c-8ab3-8c07f87ce2ff tempest-ServerActionsTestOtherA-297840239 None] Deleting attachment 45dd9f1a-c440-4c60-8af0-a52d466f950d. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "cinder-756d6511-857f-44b8-babd-3656a19c3dfc-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-756d6511-857f-44b8-babd-3656a19c3dfc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:13 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3" returned: 0 in 0.691s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:13 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3 Sep 28 18:07:13 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "cinder-quobyte-756d6511-857f-44b8-babd-3656a19c3dfc" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-quobyte-756d6511-857f-44b8-babd-3656a19c3dfc" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6c29bb-c6b4-482f-b847-2f327bea3e01]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:13 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:14 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc Sep 28 18:07:14 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Flow 'volume_create_manager' (1b264a7e-82b6-40b6-9642-e22449e17c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ea9946-37e7-43ba-80ef-fd348648edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ea9946-37e7-43ba-80ef-fd348648edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583087741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2179adb-6065-41bf-9b29-7c1513d58ac5,host='devstack@QuobyteHD#QuobyteHD',id=e621cf57-c34c-4c15-a269-0a52671e3ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c061393d931840e3b4a15eb813868686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:14Z,use_quota=True,user_id='f110f4b8623e4980a139d6f297be8d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3171235b-e5c2-4ec6-b791-6cbba95af5b0),volume_type_id=3171235b-e5c2-4ec6-b791-6cbba95af5b0)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694e3f9f-e634-40e9-9713-db44379f4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:14 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694e3f9f-e634-40e9-9713-db44379f4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fa62c7-d607-4139-aa6d-a5d4e9fdc9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fa62c7-d607-4139-aa6d-a5d4e9fdc9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e621cf57-c34c-4c15-a269-0a52671e3ece', 'volume_name': 'volume-e621cf57-c34c-4c15-a269-0a52671e3ece', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32642e2f-46cb-4e81-8bc5-9309c65cd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32642e2f-46cb-4e81-8bc5-9309c65cd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314606d5-5306-4c0f-82ca-77965d32693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:14 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Volume e621cf57-c34c-4c15-a269-0a52671e3ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e621cf57-c34c-4c15-a269-0a52671e3ece', 'volume_size': 1} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2179adb-6065-41bf-9b29-7c1513d58ac5,created_at=2026-09-28T16:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583087741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2179adb-6065-41bf-9b29-7c1513d58ac5,host='devstack@QuobyteHD#QuobyteHD',id=e621cf57-c34c-4c15-a269-0a52671e3ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c061393d931840e3b4a15eb813868686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:14Z,use_quota=True,user_id='f110f4b8623e4980a139d6f297be8d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3171235b-e5c2-4ec6-b791-6cbba95af5b0),volume_type_id=3171235b-e5c2-4ec6-b791-6cbba95af5b0)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Creating volume e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:14 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dea59674-2e51-4f13-9e00-2dc1d57be5c3" returned: 0 in 0.588s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:14 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece 1073741824 Sep 28 18:07:14 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Lock "cinder-quobyte-dea59674-2e51-4f13-9e00-2dc1d57be5c3" released by "delete_volume" :: held 1.363s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Created reservations ['419bfca6-a43f-4efd-a24e-ce6915749d0b', 'fd0a66a5-42ce-45a2-b94c-a10124132f6e', 'c2716d5b-1fb2-4903-9717-89f3caea3699', '9168d1c7-fab4-4fc5-bf60-322799947f3c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:14 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc" returned: 0 in 0.718s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:14 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:14 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:14 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc Sep 28 18:07:14 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:14 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.307s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:14 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-756d6511-857f-44b8-babd-3656a19c3dfc" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Deleted volume successfully. Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-quobyte-756d6511-857f-44b8-babd-3656a19c3dfc" released by "delete_volume" :: held 1.129s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6bb68a82-b228-41a9-8bfb-4995b85c2cf4 tempest-VolumesActionsTest-684823865 None] Lock "cinder-dea59674-2e51-4f13-9e00-2dc1d57be5c3-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:14 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece 1073741824" returned: 0 in 0.760s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG cinder.quota [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Created reservations ['eeb9bf28-04d1-48d9-b72e-c0a9758d8a9f', '06cb3eca-c568-401e-850e-0e7603383935', '33b232dd-f669-40a0-b0eb-9d9296d8a7ee', '7af9d299-45cb-4758-b378-704b8459cc3a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:15 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece Sep 28 18:07:15 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:15 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:15 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:15 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece" returned: 0 in 0.313s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314606d5-5306-4c0f-82ca-77965d32693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e621cf57-c34c-4c15-a269-0a52671e3ece', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254f4c2f-8992-48f8-8492-65482ea92705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Volume volume-e621cf57-c34c-4c15-a269-0a52671e3ece (e621cf57-c34c-4c15-a269-0a52671e3ece): created successfully Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254f4c2f-8992-48f8-8492-65482ea92705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Flow 'volume_create_manager' (1b264a7e-82b6-40b6-9642-e22449e17c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a7e51489-388c-4afe-9238-ad013aa5985f tempest-GroupsV314Test-1231710330 None] Created volume successfully. Sep 28 18:07:15 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.364s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.manager [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Deleted volume successfully. Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-1ae2878c-5fed-47c1-9f19-59ca3c297fd5 req-4f72c24d-41c2-499a-8175-1a8039d85de4 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-756d6511-857f-44b8-babd-3656a19c3dfc-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "cinder-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "cinder-quobyte-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-quobyte-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3d1a76-9f86-4433-95e3-d1ee65e82514]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:16 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d Sep 28 18:07:16 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:16 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d" returned: 0 in 0.482s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:16 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d Sep 28 18:07:16 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:16 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d" returned: 0 in 0.481s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-quobyte-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d" released by "delete_volume" :: held 1.065s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Created reservations ['71f1f970-406a-444c-9f86-36217e3502d0', '23c3eba0-01fe-4879-b8ce-da4d56dd5907', '0257d9e1-9776-4063-b6b0-6845635e654f', 'f2ea6139-84b4-4bf7-b1e5-2ea1b2daa66d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:17 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:17 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:17 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Cloning volume e621cf57-c34c-4c15-a269-0a52671e3ece to volume 9bb77d26-22b9-49cf-bb2f-3f8b57be198a Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Creating offline snapshot ce07f5be-1c3c-45b4-8494-617864211b65 of volume e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:07:17 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e149ab-9f1b-49e1-ab95-fa71e08bf72c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.522s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Deleted volume successfully. Sep 28 18:07:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b88e1b85-fd5f-41a1-abe6-db83f1a25bf0 tempest-ServerActionsTestOtherA-297840239 None] Lock "cinder-f9d7cace-8b1c-4f76-af81-16c8f4b2d64d-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:17 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece Sep 28 18:07:17 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:18 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece" returned: 0 in 0.819s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:18 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 1G Sep 28 18:07:18 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:19 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 1G" returned: 0 in 0.783s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e621cf57-c34c-4c15-a269-0a52671e3ece -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:19 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e621cf57-c34c-4c15-a269-0a52671e3ece -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 Sep 28 18:07:19 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:19 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e621cf57-c34c-4c15-a269-0a52671e3ece -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65" returned: 0 in 0.619s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:19 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:07:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:19 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 Sep 28 18:07:19 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:20 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:20 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info Sep 28 18:07:20 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:20 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info" returned: 0 in 0.415s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:20 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:07:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:20 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info Sep 28 18:07:20 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:21 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.info" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Acquiring lock "cinder-quobyte-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] snapshot: ce07f5be-1c3c-45b4-8494-617864211b65, volume: 9bb77d26-22b9-49cf-bb2f-3f8b57be198a, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efbeb35-f2e3-473f-9140-8e21ce821d38]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:21 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 Sep 28 18:07:21 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:21 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65" returned: 0 in 0.451s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e621cf57-c34c-4c15-a269-0a52671e3ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c0f46-0fbd-4279-825d-2565e1fdda22]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:21 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece Sep 28 18:07:21 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:22 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece" returned: 0 in 0.535s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:07:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:07:22 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:07:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:22 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a Sep 28 18:07:22 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:23 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:23 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:24 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.688s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:07:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:07:30 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=122,cinder:UPDATE=145,cinder:DELETE=10,cinder:INSERT=30 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:30 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=145,cinder:SELECT=117,cinder:INSERT=41,cinder:DELETE=10 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:31 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" returned: 0 in 8.905s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:07:31 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Converted 1024.00 MB image at 114.98 MB/s Sep 28 18:07:31 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:31 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a Sep 28 18:07:31 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:31 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" returned: 0 in 0.265s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" released by "_copy_volume_from_snapshot" :: held 10.262s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Acquiring lock "cinder-quobyte-ce07f5be-1c3c-45b4-8494-617864211b65" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-ce07f5be-1c3c-45b4-8494-617864211b65" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Deleting offline snapshot ce07f5be-1c3c-45b4-8494-617864211b65 of volume e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] snapshot_file for this snap is: volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab9bb81-3702-472e-9318-e63d9a2908b9]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:31 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 Sep 28 18:07:31 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:32 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65" returned: 0 in 0.567s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e621cf57-c34c-4c15-a269-0a52671e3ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:32 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ddc5f-b672-48e7-8f86-2f5b917a019e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:32 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece Sep 28 18:07:32 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:32 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece" returned: 0 in 0.619s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:32 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 Sep 28 18:07:32 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:33 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65" returned: 0 in 0.494s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:33 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65 Sep 28 18:07:33 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:33 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece.ce07f5be-1c3c-45b4-8494-617864211b65" returned: 0 in 0.357s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-ce07f5be-1c3c-45b4-8494-617864211b65" released by "_delete_snapshot" :: held 2.203s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.059s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-58747972-bf8c-49b2-bc23-c25bffd45859 tempest-GroupsV314Test-1231710330 None] Create group from source-group-d2179adb-6065-41bf-9b29-7c1513d58ac5 completed successfully. Sep 28 18:07:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Acquiring lock "cinder-quobyte-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3eb3d5-931a-4457-aa0f-9485f7279f16]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:35 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a Sep 28 18:07:35 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:35 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" returned: 0 in 0.609s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:35 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a Sep 28 18:07:35 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:36 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" returned: 0 in 0.404s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-9bb77d26-22b9-49cf-bb2f-3f8b57be198a" released by "delete_volume" :: held 1.100s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Created reservations ['c51a9a0f-b6a4-4918-ad3b-60c5b01b8ffb'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:36 devstack cinder-volume[87096]: WARNING cinder.quota [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1964530932 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1964530932, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:07:36 devstack cinder-volume[87096]: WARNING cinder.quota [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1964530932 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1964530932, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Created reservations ['a64ebac4-09b4-43dc-8c92-51c2243d2f90', '7b107120-7fd0-495e-95c7-fb831cabfa7a', 'c8a24825-7511-485a-ae91-674b68a1b821', 'f28338c2-45e7-4d3a-99dd-9556cd81fd8f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:36 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:36 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:37 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.324s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:37 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-25e14dc5-2e36-41df-a4f4-230142632a64 tempest-GroupsV314Test-1231710330 None] Delete group completed successfully. Sep 28 18:07:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Acquiring lock "cinder-quobyte-e621cf57-c34c-4c15-a269-0a52671e3ece" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-e621cf57-c34c-4c15-a269-0a52671e3ece" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf59eac-2b3d-47e7-a5cf-bca49e64fdc8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:38 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece Sep 28 18:07:38 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:38 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece" returned: 0 in 0.459s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:38 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece Sep 28 18:07:38 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:39 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e621cf57-c34c-4c15-a269-0a52671e3ece" returned: 0 in 0.672s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Lock "cinder-quobyte-e621cf57-c34c-4c15-a269-0a52671e3ece" released by "delete_volume" :: held 1.274s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Created reservations ['67ea6081-d470-46d1-8cfa-258663c379dc'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Created reservations ['66b70ec1-06c9-45e7-a7cc-bb09690410f1', '8962e986-2eb3-4318-8a59-55188fbe2a0e', '8503eacf-a449-49d5-9bf1-e297bd7f8d3b', '95ac7731-3eaa-4c27-8107-39c2c42df271'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:39 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:07:40 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:40 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.402s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:40 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-cea382a6-3715-4a32-9bdd-2ad010c58c30 tempest-GroupsV314Test-1231710330 None] Delete group completed successfully. Sep 28 18:07:49 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=22,cinder:SELECT=18,cinder:INSERT=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:49 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=27,cinder:SELECT=18,cinder:INSERT=4 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Flow 'volume_create_manager' (f0777a8d-d86e-4021-9b62-c1da94a6f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a6f7e4-f653-43bb-b658-f53f91a7f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a6f7e4-f653-43bb-b658-f53f91a7f507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2038431134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e19a2c-8664-4d10-8ce1-c26100888a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931a92fbf2364fc0af51ec3be50f7318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:51Z,use_quota=True,user_id='807bb60fe7c845929c545c6527f4cba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f167d86-f793-40d5-b674-d48f3c802c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f167d86-f793-40d5-b674-d48f3c802c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2262575-d80a-49d6-8305-45305b7bd712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2262575-d80a-49d6-8305-45305b7bd712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e19a2c-8664-4d10-8ce1-c26100888a60', 'volume_name': 'volume-a3e19a2c-8664-4d10-8ce1-c26100888a60', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8ae95f-a973-40c0-abd8-5f5023f24b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8ae95f-a973-40c0-abd8-5f5023f24b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45a8c00-c91f-4369-8335-648a2c0dc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Volume a3e19a2c-8664-4d10-8ce1-c26100888a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e19a2c-8664-4d10-8ce1-c26100888a60', 'volume_size': 1} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2038431134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e19a2c-8664-4d10-8ce1-c26100888a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931a92fbf2364fc0af51ec3be50f7318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:51Z,use_quota=True,user_id='807bb60fe7c845929c545c6527f4cba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Creating volume a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:51 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:51 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 1073741824 Sep 28 18:07:51 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:51 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 1073741824" returned: 0 in 0.787s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:52 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 Sep 28 18:07:52 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:52 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60" returned: 0 in 0.462s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45a8c00-c91f-4369-8335-648a2c0dc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e19a2c-8664-4d10-8ce1-c26100888a60', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb18092-7ada-4413-8237-9de4785ab7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Volume volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 (a3e19a2c-8664-4d10-8ce1-c26100888a60): created successfully Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb18092-7ada-4413-8237-9de4785ab7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Flow 'volume_create_manager' (f0777a8d-d86e-4021-9b62-c1da94a6f372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-326284c7-03c0-4294-a416-1eea134a3d48 tempest-SnapshotMetadataTestJSON-780043451 None] Created volume successfully. Sep 28 18:07:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Creating offline snapshot 1c655df8-ba2f-4b29-9dde-46d239e89855 of volume a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:07:53 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Flow 'volume_create_manager' (6eb1bc7e-a156-4af9-9462-d08691bc1a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e7a01a-898a-4d87-b23d-2d039a49ccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad71234-a761-4cc2-9c45-e916d49cc872]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e7a01a-898a-4d87-b23d-2d039a49ccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1409675642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e892e6812f438f8af8e0d299bfbc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:54Z,use_quota=True,user_id='de484498ddff4878b2f4bea9996334a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69fab825-0383-4356-aaf8-dea9dfc2b576),volume_type_id=69fab825-0383-4356-aaf8-dea9dfc2b576)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d958d104-df94-4ee6-b973-a2da1f340ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d958d104-df94-4ee6-b973-a2da1f340ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3cdcf7-2793-416a-acf3-03a46c9d49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3cdcf7-2793-416a-acf3-03a46c9d49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb', 'volume_name': 'volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2163f75f-4634-4879-9cd1-26bfdf102e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2163f75f-4634-4879-9cd1-26bfdf102e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b77306c-e1db-450f-b029-bac7b6e395bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Volume 7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb', 'volume_size': 1} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:54 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 Sep 28 18:07:54 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:54 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60" returned: 0 in 0.731s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:54 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 1G Sep 28 18:07:54 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:55 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 1G" returned: 0 in 0.663s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:55 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 Sep 28 18:07:55 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:55 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855" returned: 0 in 0.479s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:55 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 is being set with open permissions: ugo+rw Sep 28 18:07:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:55 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 Sep 28 18:07:55 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:56 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855" returned: 0 in 0.390s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:56 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info Sep 28 18:07:56 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:56 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info" returned: 0 in 0.379s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:56 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info is being set with open permissions: ugo+rw Sep 28 18:07:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:56 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info Sep 28 18:07:56 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:57 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.info" returned: 0 in 0.446s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.303s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.066s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1409675642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e892e6812f438f8af8e0d299bfbc85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:54Z,use_quota=True,user_id='de484498ddff4878b2f4bea9996334a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69fab825-0383-4356-aaf8-dea9dfc2b576),volume_type_id=69fab825-0383-4356-aaf8-dea9dfc2b576)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Creating volume 7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:57 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:07:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:57 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb 1073741824 Sep 28 18:07:57 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3a464d97-e398-4099-9052-b8ec5c4247eb tempest-SnapshotMetadataTestJSON-780043451 None] Create snapshot completed successfully Sep 28 18:07:58 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb 1073741824" returned: 0 in 1.017s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:58 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb Sep 28 18:07:58 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:59 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb" returned: 0 in 0.756s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b77306c-e1db-450f-b029-bac7b6e395bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b82ac89-2e53-4730-b393-353f200c69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:59 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Volume volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb (7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb): created successfully Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b82ac89-2e53-4730-b393-353f200c69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Flow 'volume_create_manager' (6eb1bc7e-a156-4af9-9462-d08691bc1a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b3d31c5b-6149-4293-bb94-bf9220fa1827 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Created volume successfully. Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "cinder-1c655df8-ba2f-4b29-9dde-46d239e89855-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-1c655df8-ba2f-4b29-9dde-46d239e89855-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "cinder-quobyte-a3e19a2c-8664-4d10-8ce1-c26100888a60" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-quobyte-a3e19a2c-8664-4d10-8ce1-c26100888a60" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "cinder-quobyte-1c655df8-ba2f-4b29-9dde-46d239e89855" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-quobyte-1c655df8-ba2f-4b29-9dde-46d239e89855" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Deleting offline snapshot 1c655df8-ba2f-4b29-9dde-46d239e89855 of volume a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] snapshot_file for this snap is: volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[629733b7-b40c-48e4-9383-0646168312bd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:00 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 Sep 28 18:08:00 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:01 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855" returned: 0 in 1.164s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3e19a2c-8664-4d10-8ce1-c26100888a60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5515d14b-ae9d-4d35-aff7-178b708e0b9e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:01 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 Sep 28 18:08:01 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:01 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:01 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:02 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60" returned: 0 in 0.793s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:02 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 Sep 28 18:08:02 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.706s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:02 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:02 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8623cdf3-dd72-4e2c-9629-20f811ba2434 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Retype volume completed successfully. Sep 28 18:08:03 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855" returned: 0 in 0.841s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:03 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855 Sep 28 18:08:03 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Acquiring lock "cinder-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "cinder-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Acquiring lock "cinder-quobyte-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "cinder-quobyte-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c395ecfa-e664-41b9-a5dc-c29d0a67a02f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:03 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60.1c655df8-ba2f-4b29-9dde-46d239e89855" returned: 0 in 0.393s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-quobyte-1c655df8-ba2f-4b29-9dde-46d239e89855" released by "_delete_snapshot" :: held 3.458s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:03 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb Sep 28 18:08:03 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-quobyte-a3e19a2c-8664-4d10-8ce1-c26100888a60" released by "delete_snapshot" :: held 3.520s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Created reservations ['29cdda34-ad5a-47a0-8810-fb8f6473bdfa', 'ec4d06a2-184e-4a44-9d9b-8c20ebf1c881', '56b40244-b66f-4d68-b1da-3cbb183af4f9', '6c967280-fbe0-4ccb-854f-14eefa0d0e9c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:03 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Delete snapshot completed successfully. Sep 28 18:08:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-43b84696-4697-4cc0-9cbf-bf902fc81241 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-1c655df8-ba2f-4b29-9dde-46d239e89855-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:04 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb" returned: 0 in 0.617s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb Sep 28 18:08:04 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb" returned: 0 in 0.286s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "cinder-quobyte-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb" released by "delete_volume" :: held 0.983s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:04 devstack cinder-volume[87096]: WARNING cinder.quota [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:04 devstack cinder-volume[87096]: WARNING cinder.quota [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Created reservations ['a734cd47-326a-4eaf-adf2-a8593f7f1844', 'f877978e-3da2-41fd-a961-52d86e4f946f', '434c6c9f-6f2d-4c44-9217-2e0e08966926', 'f7f0c8f1-b659-4e1d-9a88-c89cfdd0e7e9'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "cinder-a3e19a2c-8664-4d10-8ce1-c26100888a60-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-a3e19a2c-8664-4d10-8ce1-c26100888a60-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:04 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:04 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "cinder-quobyte-a3e19a2c-8664-4d10-8ce1-c26100888a60" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-quobyte-a3e19a2c-8664-4d10-8ce1-c26100888a60" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2630a7ea-42bc-44e9-8441-0f95be2572fe]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 Sep 28 18:08:04 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.402s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Deleted volume successfully. Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f254b874-5374-4075-a46b-0aa55a7283c8 tempest-VolumeRetypeWithoutMigrationTest-1667294362 None] Lock "cinder-7e7cc9ba-a9de-4bb6-b08d-92c6d7d664bb-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:05 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60" returned: 0 in 0.520s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60 Sep 28 18:08:05 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a3e19a2c-8664-4d10-8ce1-c26100888a60" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-quobyte-a3e19a2c-8664-4d10-8ce1-c26100888a60" released by "delete_volume" :: held 1.007s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Created reservations ['aebc8aa7-57d1-4e09-a022-df7065df1ce7', 'e5641086-05d4-43d1-a08c-bc35d775b7a3', 'd2308c96-5ee4-45f3-ab7f-5da1dc9b5e5b', '98d1f0c9-bb74-4d1b-8c16-a4280cb0769b'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:06 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:06 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.272s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:06 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Deleted volume successfully. Sep 28 18:08:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3bef0460-c885-48dc-b175-324307af5cc4 tempest-SnapshotMetadataTestJSON-780043451 None] Lock "cinder-a3e19a2c-8664-4d10-8ce1-c26100888a60-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Flow 'volume_create_manager' (981c6f4c-a4dd-40a7-9326-dd42438a62b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc1f6d-71e0-491a-9437-ed166dca1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc1f6d-71e0-491a-9437-ed166dca1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-464905868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626aac5c-6b9e-4d58-9fb8-8a30b75431d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef795c674c78405a93539f00fcf5d83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:15Z,use_quota=True,user_id='b9715b52fb7c4bb0a30d09b2b41c9e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9266fbc7-0f1d-493d-80e6-3e1c3432bf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9266fbc7-0f1d-493d-80e6-3e1c3432bf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e9e1e-3710-4b65-9ef6-f4a1c78c88d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e9e1e-3710-4b65-9ef6-f4a1c78c88d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626aac5c-6b9e-4d58-9fb8-8a30b75431d9', 'volume_name': 'volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5b92de-d646-476a-83e6-f27c5c552d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5b92de-d646-476a-83e6-f27c5c552d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0f9249-e1c2-44d8-9a5b-b9967a0a1f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Volume 626aac5c-6b9e-4d58-9fb8-8a30b75431d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9', 'volume_size': 1} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-464905868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626aac5c-6b9e-4d58-9fb8-8a30b75431d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef795c674c78405a93539f00fcf5d83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:15Z,use_quota=True,user_id='b9715b52fb7c4bb0a30d09b2b41c9e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Creating volume 626aac5c-6b9e-4d58-9fb8-8a30b75431d9 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:15 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:15 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 1073741824 Sep 28 18:08:15 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:16 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 1073741824" returned: 0 in 0.741s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:16 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 Sep 28 18:08:16 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:16 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9" returned: 0 in 0.418s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0f9249-e1c2-44d8-9a5b-b9967a0a1f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa9dc24-6835-4000-9a5a-cf4c5476588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:16 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Volume volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 (626aac5c-6b9e-4d58-9fb8-8a30b75431d9): created successfully Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa9dc24-6835-4000-9a5a-cf4c5476588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Flow 'volume_create_manager' (981c6f4c-a4dd-40a7-9326-dd42438a62b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-139878be-cad5-4723-9c7f-93634cfed255 tempest-AbsoluteLimitsTests-2131399223 None] Created volume successfully. Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Flow 'volume_create_manager' (58951932-55a3-4e35-8944-227c0a13c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c5c3ee-6324-48a6-9411-428c8dc1656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c5c3ee-6324-48a6-9411-428c8dc1656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1956374193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef64fcd-e893-4ca7-8766-e5ab3ec52b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee868c27d4ba4601afe602486051ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:18Z,use_quota=True,user_id='9a3228956a06429c9ab218ccd3343ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f3a17a-fb40-4e3a-8e31-1b8447630d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f3a17a-fb40-4e3a-8e31-1b8447630d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1fd740-fb64-48e3-af11-8e5807991ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1fd740-fb64-48e3-af11-8e5807991ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef64fcd-e893-4ca7-8766-e5ab3ec52b93', 'volume_name': 'volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962d2f62-f56d-4fea-b029-15b2a12b7638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962d2f62-f56d-4fea-b029-15b2a12b7638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bc2117-024e-478e-ae19-149eb09f8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:18 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Volume fef64fcd-e893-4ca7-8766-e5ab3ec52b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93', 'volume_size': 1} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1956374193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef64fcd-e893-4ca7-8766-e5ab3ec52b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee868c27d4ba4601afe602486051ce29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:18Z,use_quota=True,user_id='9a3228956a06429c9ab218ccd3343ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Creating volume fef64fcd-e893-4ca7-8766-e5ab3ec52b93 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:18 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Acquiring lock "cinder-626aac5c-6b9e-4d58-9fb8-8a30b75431d9-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Lock "cinder-626aac5c-6b9e-4d58-9fb8-8a30b75431d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:18 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 1073741824 Sep 28 18:08:18 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Acquiring lock "cinder-quobyte-626aac5c-6b9e-4d58-9fb8-8a30b75431d9" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Lock "cinder-quobyte-626aac5c-6b9e-4d58-9fb8-8a30b75431d9" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a004a2-7857-4e35-914a-6ee59c35f7c8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:18 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 Sep 28 18:08:18 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:19 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Flow 'volume_create_manager' (5e242f33-08ae-4097-9abd-7fb947f80c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de173ea6-f968-4791-904f-b99b1731029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9" returned: 0 in 0.680s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:19 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9 Sep 28 18:08:19 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de173ea6-f968-4791-904f-b99b1731029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1573160324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01809845-f531-4fab-8014-be8362f61e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8573ef0c13249ac9c04673364925b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:19Z,use_quota=True,user_id='24a4a38f556d4afcac30df038b99f861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43e7d24-3b30-4d40-9a11-f16f948072d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43e7d24-3b30-4d40-9a11-f16f948072d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a905332-280d-4ecb-8109-53b0d31cc3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a905332-280d-4ecb-8109-53b0d31cc3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01809845-f531-4fab-8014-be8362f61e5a', 'volume_name': 'volume-01809845-f531-4fab-8014-be8362f61e5a', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c67e1e-b92f-4faa-aa73-6090457f71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c67e1e-b92f-4faa-aa73-6090457f71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d7f447-8e28-401f-9c62-d3fccc391755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:19 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Volume 01809845-f531-4fab-8014-be8362f61e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01809845-f531-4fab-8014-be8362f61e5a', 'volume_size': 1} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:19 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 1073741824" returned: 0 in 1.149s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:19 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 Sep 28 18:08:19 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:19 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-626aac5c-6b9e-4d58-9fb8-8a30b75431d9" returned: 0 in 0.445s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Lock "cinder-quobyte-626aac5c-6b9e-4d58-9fb8-8a30b75431d9" released by "delete_volume" :: held 1.200s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Created reservations ['bcf0a480-2acc-454d-90d5-89159ef66920', 'dc6183a5-dc74-49ff-8d94-81c8ac3e6c64', '723c8def-908f-46ed-868d-9b92294c78c8', '480eac5e-15d2-4722-9867-4696a9d64adf'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:20 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93" returned: 0 in 0.474s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:20 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:20 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1573160324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01809845-f531-4fab-8014-be8362f61e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8573ef0c13249ac9c04673364925b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:19Z,use_quota=True,user_id='24a4a38f556d4afcac30df038b99f861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Creating volume 01809845-f531-4fab-8014-be8362f61e5a {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:20 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bc2117-024e-478e-ae19-149eb09f8664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532761b4-99a6-405a-911b-733bb1e5ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:20 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a 1073741824 Sep 28 18:08:20 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Volume volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 (fef64fcd-e893-4ca7-8766-e5ab3ec52b93): created successfully Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532761b4-99a6-405a-911b-733bb1e5ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Flow 'volume_create_manager' (58951932-55a3-4e35-8944-227c0a13c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:20 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-15646b69-9002-4280-844d-141cb5a8eb6f tempest-VolumesServicesTestJSON-1544678580 None] Created volume successfully. Sep 28 18:08:20 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.515s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:20 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Deleted volume successfully. Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-987cbb6e-3947-4dc8-a6df-d7741d93ee5a tempest-AbsoluteLimitsTests-2131399223 None] Lock "cinder-626aac5c-6b9e-4d58-9fb8-8a30b75431d9-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:20 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a 1073741824" returned: 0 in 0.708s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:20 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a Sep 28 18:08:20 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:21 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a" returned: 0 in 0.391s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d7f447-8e28-401f-9c62-d3fccc391755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01809845-f531-4fab-8014-be8362f61e5a', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbc828d-e745-42f7-986d-fdd134daa086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:21 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Volume volume-01809845-f531-4fab-8014-be8362f61e5a (01809845-f531-4fab-8014-be8362f61e5a): created successfully Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbc828d-e745-42f7-986d-fdd134daa086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Flow 'volume_create_manager' (5e242f33-08ae-4097-9abd-7fb947f80c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:21 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0511ff5f-e459-4ded-96c9-b3d841c7b1a1 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Created volume successfully. Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Acquiring lock "cinder-fef64fcd-e893-4ca7-8766-e5ab3ec52b93-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Lock "cinder-fef64fcd-e893-4ca7-8766-e5ab3ec52b93-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Acquiring lock "cinder-quobyte-fef64fcd-e893-4ca7-8766-e5ab3ec52b93" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Lock "cinder-quobyte-fef64fcd-e893-4ca7-8766-e5ab3ec52b93" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4bf68-6e3f-4049-9723-01e470eca776]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:22 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 Sep 28 18:08:22 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:22 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93" returned: 0 in 1.004s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:22 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93 Sep 28 18:08:22 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:23 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fef64fcd-e893-4ca7-8766-e5ab3ec52b93" returned: 0 in 0.655s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Lock "cinder-quobyte-fef64fcd-e893-4ca7-8766-e5ab3ec52b93" released by "delete_volume" :: held 1.775s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Created reservations ['ac657f72-71c1-47f4-80e3-6937b5cd4965', 'f382febb-23f5-41c1-868d-74e20ccc0999', '48dddaf8-3621-47cc-ad54-fcd6c96e1eb8', 'a563faa5-5e92-4045-90ba-676a4811e9b1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:23 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:23 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:23 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:23 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:24 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:08:24 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.725s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Deleted volume successfully. Sep 28 18:08:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9e51a38c-e147-44b2-8dab-90b0ea7352fb tempest-VolumesServicesTestJSON-1544678580 None] Lock "cinder-fef64fcd-e893-4ca7-8766-e5ab3ec52b93-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-cd744d06-ba58-450b-aa5e-3e0e0ff4e903 req-18d683a8-41ee-41a8-9cba-e7698c8f81c6 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-cd744d06-ba58-450b-aa5e-3e0e0ff4e903 req-18d683a8-41ee-41a8-9cba-e7698c8f81c6 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-cd744d06-ba58-450b-aa5e-3e0e0ff4e903 req-18d683a8-41ee-41a8-9cba-e7698c8f81c6 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-cd744d06-ba58-450b-aa5e-3e0e0ff4e903 req-18d683a8-41ee-41a8-9cba-e7698c8f81c6 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-01809845-f531-4fab-8014-be8362f61e5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b542432-3dde-4d80-ab5b-3f13fa972119', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:08:25 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-cd744d06-ba58-450b-aa5e-3e0e0ff4e903 req-18d683a8-41ee-41a8-9cba-e7698c8f81c6 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] attachment_update completed successfully. Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Flow 'volume_create_manager' (767ab374-8cb2-4450-991c-03a5ce45db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0cd8d3-3ef7-4876-9c64-4ec7d5632f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0cd8d3-3ef7-4876-9c64-4ec7d5632f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1501234607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0caf45-12ab-49b1-9804-aa925eb32b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd66a55d3c5b411185dc06a0a5c8a83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:33Z,use_quota=True,user_id='2811e6d3efb9440d9406b2ddaa55099a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc312a5-e2b6-472b-a70c-13e6fcbe9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc312a5-e2b6-472b-a70c-13e6fcbe9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6e60c4-f7fc-407b-8aae-37c2a67b9f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c6e60c4-f7fc-407b-8aae-37c2a67b9f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0caf45-12ab-49b1-9804-aa925eb32b97', 'volume_name': 'volume-bd0caf45-12ab-49b1-9804-aa925eb32b97', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be04563-78c6-4562-8a23-aba7e2e4cc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be04563-78c6-4562-8a23-aba7e2e4cc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e751878d-2839-4132-a4ad-4954ea4b21bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Volume bd0caf45-12ab-49b1-9804-aa925eb32b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0caf45-12ab-49b1-9804-aa925eb32b97', 'volume_size': 1} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1501234607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0caf45-12ab-49b1-9804-aa925eb32b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd66a55d3c5b411185dc06a0a5c8a83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:33Z,use_quota=True,user_id='2811e6d3efb9440d9406b2ddaa55099a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Creating volume bd0caf45-12ab-49b1-9804-aa925eb32b97 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:33 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:33 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 1073741824 Sep 28 18:08:33 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-36c6310e-5524-4fe0-9cdc-4e0c94e66747 req-a09a6539-7ba3-40fb-883d-0692a07a7719 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Terminate volume connection completed successfully. Sep 28 18:08:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-36c6310e-5524-4fe0-9cdc-4e0c94e66747 req-a09a6539-7ba3-40fb-883d-0692a07a7719 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Deleting attachment 3b542432-3dde-4d80-ab5b-3f13fa972119. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:08:34 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 1073741824" returned: 0 in 0.949s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:34 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 Sep 28 18:08:34 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:34 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97" returned: 0 in 0.520s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e751878d-2839-4132-a4ad-4954ea4b21bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0caf45-12ab-49b1-9804-aa925eb32b97', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b87d7a-5318-46be-b705-17ceb7f1b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Volume volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 (bd0caf45-12ab-49b1-9804-aa925eb32b97): created successfully Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b87d7a-5318-46be-b705-17ceb7f1b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Flow 'volume_create_manager' (767ab374-8cb2-4450-991c-03a5ce45db92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b74bf1c4-605a-4c2c-8da6-f76bdce6f004 tempest-VolumesMetadataTest-1231244964 None] Created volume successfully. Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Acquiring lock "cinder-01809845-f531-4fab-8014-be8362f61e5a-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "cinder-01809845-f531-4fab-8014-be8362f61e5a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Acquiring lock "cinder-quobyte-01809845-f531-4fab-8014-be8362f61e5a" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "cinder-quobyte-01809845-f531-4fab-8014-be8362f61e5a" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3bd67e-da38-461f-b380-dcf650b54444]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:35 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a Sep 28 18:08:35 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:35 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a" returned: 0 in 0.547s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:35 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a Sep 28 18:08:35 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:36 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-01809845-f531-4fab-8014-be8362f61e5a" returned: 0 in 0.476s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "cinder-quobyte-01809845-f531-4fab-8014-be8362f61e5a" released by "delete_volume" :: held 1.122s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Created reservations ['6004fda1-83d5-4c9b-a92c-6be456f9748b', 'dee53b9d-fcb9-43a8-8e34-f9f292f60807', 'a54e24da-eab9-4425-8c2e-6aa59ee02e39', '6ff9a5e3-a64c-4de1-b832-a0e6f5489a30'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:36 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:36 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Acquiring lock "cinder-bd0caf45-12ab-49b1-9804-aa925eb32b97-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Lock "cinder-bd0caf45-12ab-49b1-9804-aa925eb32b97-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Acquiring lock "cinder-quobyte-bd0caf45-12ab-49b1-9804-aa925eb32b97" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Lock "cinder-quobyte-bd0caf45-12ab-49b1-9804-aa925eb32b97" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:37 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.595s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c153f-c075-4941-b609-19cf406f33c8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Deleted volume successfully. Sep 28 18:08:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e232bc41-f38a-4c0c-a6bd-88be938b28c4 tempest-TestServerVolumeAttachScenarioOldVersion-876578080 None] Lock "cinder-01809845-f531-4fab-8014-be8362f61e5a-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:37 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 Sep 28 18:08:37 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:38 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97" returned: 0 in 0.970s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:38 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97 Sep 28 18:08:38 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:38 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bd0caf45-12ab-49b1-9804-aa925eb32b97" returned: 0 in 0.595s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Lock "cinder-quobyte-bd0caf45-12ab-49b1-9804-aa925eb32b97" released by "delete_volume" :: held 1.679s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Created reservations ['450f7184-d6e7-4da2-8a63-1bba487954a5', '0687276f-9239-47d0-b2b3-a07005d073fd', '1505ad4c-bbd4-4656-90d9-36995b447f20', '62d8e54d-5db1-4410-9270-a23e6e7ec53a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:39 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:39 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:39 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.470s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Deleted volume successfully. Sep 28 18:08:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7244199-c595-4345-8e97-c55ca68b6891 tempest-VolumesMetadataTest-1231244964 None] Lock "cinder-bd0caf45-12ab-49b1-9804-aa925eb32b97-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Flow 'volume_create_manager' (7d5d7ad5-91f7-4cfe-9b15-d1b37f723a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d88c1b-9607-442f-ab18-33fc56c4c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d88c1b-9607-442f-ab18-33fc56c4c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1593413543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777adf06-e7bf-429d-9a9f-a98f8858ea29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634ece93c2b04f85ae5308d15f7c3598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:41Z,use_quota=True,user_id='d7255b2affb5433480199913d63daa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efc9bd5-2d58-474c-ba90-dad61f6df9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5efc9bd5-2d58-474c-ba90-dad61f6df9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bd853b-1170-4f06-a28f-aece6f1ffba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bd853b-1170-4f06-a28f-aece6f1ffba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777adf06-e7bf-429d-9a9f-a98f8858ea29', 'volume_name': 'volume-777adf06-e7bf-429d-9a9f-a98f8858ea29', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40e7147-e4be-4d1a-aa8f-3aed50a1b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40e7147-e4be-4d1a-aa8f-3aed50a1b80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8db5bb3-b094-4954-abf0-2d8020833025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Volume 777adf06-e7bf-429d-9a9f-a98f8858ea29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777adf06-e7bf-429d-9a9f-a98f8858ea29', 'volume_size': 1} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1593413543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777adf06-e7bf-429d-9a9f-a98f8858ea29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634ece93c2b04f85ae5308d15f7c3598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:41Z,use_quota=True,user_id='d7255b2affb5433480199913d63daa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Creating volume 777adf06-e7bf-429d-9a9f-a98f8858ea29 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:40 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:40 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 1073741824 Sep 28 18:08:40 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 1073741824" returned: 0 in 0.751s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 Sep 28 18:08:41 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29" returned: 0 in 0.409s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8db5bb3-b094-4954-abf0-2d8020833025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777adf06-e7bf-429d-9a9f-a98f8858ea29', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea831cf3-910b-4240-aa34-08ce00c00b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Volume volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 (777adf06-e7bf-429d-9a9f-a98f8858ea29): created successfully Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea831cf3-910b-4240-aa34-08ce00c00b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Flow 'volume_create_manager' (7d5d7ad5-91f7-4cfe-9b15-d1b37f723a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2c2fe968-e181-4688-9fb8-652091e89603 tempest-ServersNegativeTestJSON-863994713 None] Created volume successfully. Sep 28 18:08:44 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Flow 'volume_create_manager' (963b1385-c3df-40bc-8d34-f10ea209873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4020679-eb05-485e-ba4d-18de32cf3c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4020679-eb05-485e-ba4d-18de32cf3c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1960860120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb13df-bd00-4ff1-bcb7-d403fff0e0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634ece93c2b04f85ae5308d15f7c3598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:45Z,use_quota=True,user_id='d7255b2affb5433480199913d63daa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0417a0fc-4bdd-4d88-a5a7-665b1877a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0417a0fc-4bdd-4d88-a5a7-665b1877a652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c8b164-c46a-4632-87e1-08d95c6e8ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c8b164-c46a-4632-87e1-08d95c6e8ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eb13df-bd00-4ff1-bcb7-d403fff0e0f6', 'volume_name': 'volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f79ab8f-ff12-4143-8f90-fc11610e1315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f79ab8f-ff12-4143-8f90-fc11610e1315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77aad65-a2a7-4f43-8606-84085953d36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:45 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Volume 98eb13df-bd00-4ff1-bcb7-d403fff0e0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6', 'volume_size': 1} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1960860120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb13df-bd00-4ff1-bcb7-d403fff0e0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='634ece93c2b04f85ae5308d15f7c3598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:45Z,use_quota=True,user_id='d7255b2affb5433480199913d63daa22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Creating volume 98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:45 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:45 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 1073741824 Sep 28 18:08:45 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:45 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 1073741824" returned: 0 in 0.666s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:45 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 Sep 28 18:08:45 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:46 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6" returned: 0 in 0.342s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77aad65-a2a7-4f43-8606-84085953d36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bb61bd-13ba-4984-9c2f-16f544e6a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:46 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Volume volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 (98eb13df-bd00-4ff1-bcb7-d403fff0e0f6): created successfully Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bb61bd-13ba-4984-9c2f-16f544e6a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Flow 'volume_create_manager' (963b1385-c3df-40bc-8d34-f10ea209873a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1d49c0f4-77cd-41c2-a2c3-7517bac63836 tempest-ServersNegativeTestJSON-863994713 None] Created volume successfully. Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Flow 'volume_create_manager' (0d724274-78fc-437b-ab18-0e430b163220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a006e8a0-1fa3-41ca-a84a-b2257b007d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a006e8a0-1fa3-41ca-a84a-b2257b007d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1890288973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bc94c5-8b5c-4751-9361-3680dd325690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f7823f96fc4d13aa768e3044b58932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:49Z,use_quota=True,user_id='9f32bfcc4c8141e7aafba2fb5d5cc5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0180202f-0ffa-4aa6-8679-21251262f4bf),volume_type_id=0180202f-0ffa-4aa6-8679-21251262f4bf)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192bd9b2-75ba-4379-8133-3796cdcb1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192bd9b2-75ba-4379-8133-3796cdcb1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cfd0d6-edc1-4668-b389-7afad3c2c83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cfd0d6-edc1-4668-b389-7afad3c2c83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4bc94c5-8b5c-4751-9361-3680dd325690', 'volume_name': 'volume-c4bc94c5-8b5c-4751-9361-3680dd325690', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd13ebc1-2188-45bf-9c84-9aeaaad58b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd13ebc1-2188-45bf-9c84-9aeaaad58b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76820a8a-7cd0-4967-aaef-f5963c1800cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:48 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Volume c4bc94c5-8b5c-4751-9361-3680dd325690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4bc94c5-8b5c-4751-9361-3680dd325690', 'volume_size': 1} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1890288973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bc94c5-8b5c-4751-9361-3680dd325690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f7823f96fc4d13aa768e3044b58932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:49Z,use_quota=True,user_id='9f32bfcc4c8141e7aafba2fb5d5cc5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0180202f-0ffa-4aa6-8679-21251262f4bf),volume_type_id=0180202f-0ffa-4aa6-8679-21251262f4bf)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Creating volume c4bc94c5-8b5c-4751-9361-3680dd325690 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:48 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:48 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 1073741824 Sep 28 18:08:48 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "cinder-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "cinder-quobyte-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-quobyte-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d2b3c-3f60-4797-9899-14f9ca9ee868]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:49 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 Sep 28 18:08:49 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:49 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 1073741824" returned: 0 in 0.844s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:49 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6" returned: 0 in 0.667s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:49 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6 Sep 28 18:08:49 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:49 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 Sep 28 18:08:49 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:50 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6" returned: 0 in 0.424s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-quobyte-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6" released by "delete_volume" :: held 1.165s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=86,cinder:SELECT=70,cinder:INSERT=16,cinder:DELETE=9 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=78,cinder:UPDATE=89,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:50 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690" returned: 0 in 0.504s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76820a8a-7cd0-4967-aaef-f5963c1800cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4bc94c5-8b5c-4751-9361-3680dd325690', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b95b6c9-cbc2-43ea-914b-5ba9451f6cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Created reservations ['aa349196-90eb-4cc2-992f-b024d172f0f2', 'b5a84a86-62cd-4480-a3b0-40f5dea72eef', '7f3f4b32-4064-4a10-854a-eb23106ae145', '913fbc30-a4a8-408b-9aa2-b87784bcca76'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:50 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Volume volume-c4bc94c5-8b5c-4751-9361-3680dd325690 (c4bc94c5-8b5c-4751-9361-3680dd325690): created successfully Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b95b6c9-cbc2-43ea-914b-5ba9451f6cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Flow 'volume_create_manager' (0d724274-78fc-437b-ab18-0e430b163220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-10dbe93e-2295-41a7-8ecd-70c84b359e23 tempest-VolumeTypesAccessTest-1599712263 None] Created volume successfully. Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:50 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:50 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:50 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.329s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Deleted volume successfully. Sep 28 18:08:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c9d35e3c-d758-46f2-9993-de0613d53686 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-98eb13df-bd00-4ff1-bcb7-d403fff0e0f6-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Acquiring lock "cinder-c4bc94c5-8b5c-4751-9361-3680dd325690-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Lock "cinder-c4bc94c5-8b5c-4751-9361-3680dd325690-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Acquiring lock "cinder-quobyte-c4bc94c5-8b5c-4751-9361-3680dd325690" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Lock "cinder-quobyte-c4bc94c5-8b5c-4751-9361-3680dd325690" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6449c8-8d1e-4dd2-b7ad-39d948fda3c3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "cinder-777adf06-e7bf-429d-9a9f-a98f8858ea29-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-777adf06-e7bf-429d-9a9f-a98f8858ea29-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "cinder-quobyte-777adf06-e7bf-429d-9a9f-a98f8858ea29" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:51 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 Sep 28 18:08:51 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-quobyte-777adf06-e7bf-429d-9a9f-a98f8858ea29" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7c64c-f7b3-453b-b4b0-461ed3487026]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:51 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 Sep 28 18:08:51 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:51 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690" returned: 0 in 0.704s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690 Sep 28 18:08:52 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29" returned: 0 in 0.528s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29 Sep 28 18:08:52 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c4bc94c5-8b5c-4751-9361-3680dd325690" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Lock "cinder-quobyte-c4bc94c5-8b5c-4751-9361-3680dd325690" released by "delete_volume" :: held 1.313s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:52 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:52 devstack cinder-volume[87096]: WARNING cinder.quota [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1422343342 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1422343342, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:52 devstack cinder-volume[87096]: WARNING cinder.quota [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1422343342 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1422343342, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-777adf06-e7bf-429d-9a9f-a98f8858ea29" returned: 0 in 0.472s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Flow 'volume_create_manager' (e8801c01-0067-4479-a38e-3e5045e8a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3dc1bc-8724-4aea-80e8-ca334f454a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-quobyte-777adf06-e7bf-429d-9a9f-a98f8858ea29" released by "delete_volume" :: held 1.130s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3dc1bc-8724-4aea-80e8-ca334f454a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-871387965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be02b81e-a58e-4fd9-a7f6-cb16adbe9adb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980744d3b38a4ee0be3443d5d223763f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:52Z,use_quota=True,user_id='236620e289d243bdb049423f323c7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686d0792-9539-478f-81d3-136ba2c6ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686d0792-9539-478f-81d3-136ba2c6ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bba145-5bb4-4d24-9c9f-859a35591575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bba145-5bb4-4d24-9c9f-859a35591575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be02b81e-a58e-4fd9-a7f6-cb16adbe9adb', 'volume_name': 'volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58e3b6-32ff-4ee8-a596-28a10b60750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a58e3b6-32ff-4ee8-a596-28a10b60750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1480578-d92e-4db6-9f0b-a03a1912e4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Volume be02b81e-a58e-4fd9-a7f6-cb16adbe9adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb', 'volume_size': 1} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-871387965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be02b81e-a58e-4fd9-a7f6-cb16adbe9adb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980744d3b38a4ee0be3443d5d223763f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:52Z,use_quota=True,user_id='236620e289d243bdb049423f323c7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Creating volume be02b81e-a58e-4fd9-a7f6-cb16adbe9adb {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:52 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Created reservations ['a2c6b215-9799-4245-b94a-80fe09de3cde', '46398585-6798-4036-828f-cbfcde339379', 'd9e007c1-3c52-438b-9698-bb3e80e49f7f', '25c441ad-ac03-47c5-9595-2594ac67755a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:52 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb 1073741824 Sep 28 18:08:52 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Created reservations ['8ca4f0c7-f1f1-41ec-831f-e9bbeaf5593d', '70b27112-d82e-4e39-a8f7-040614883744', '6f468928-f59c-4bdc-bc31-e1de80cfa450', 'bf9e9605-4c89-4130-9ab4-e01f544c36e0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:52 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:52 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:53 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:08:53 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.483s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Deleted volume successfully. Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7d660ec4-e996-437c-a834-b9c914f90914 tempest-VolumeTypesAccessTest-1599712263 None] Lock "cinder-c4bc94c5-8b5c-4751-9361-3680dd325690-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:53 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.441s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Deleted volume successfully. Sep 28 18:08:53 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb 1073741824" returned: 0 in 0.763s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c76bca77-6b30-4fe4-9962-15456e4dca29 tempest-ServersNegativeTestJSON-863994713 None] Lock "cinder-777adf06-e7bf-429d-9a9f-a98f8858ea29-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:53 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb Sep 28 18:08:53 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:53 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1480578-d92e-4db6-9f0b-a03a1912e4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a25d8a-8731-4e82-8dff-87db93c0409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Volume volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb (be02b81e-a58e-4fd9-a7f6-cb16adbe9adb): created successfully Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a25d8a-8731-4e82-8dff-87db93c0409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Flow 'volume_create_manager' (e8801c01-0067-4479-a38e-3e5045e8a57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-08b83b11-b5fc-41de-a565-6e320afc0bb8 tempest-VolumesListTestJSON-164738871 None] Created volume successfully. Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Flow 'volume_create_manager' (0863aa20-c98e-491a-a4e4-b527f4259fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d468f9b2-85f7-4bf1-9170-1569ea9615fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d468f9b2-85f7-4bf1-9170-1569ea9615fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-805552481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4fc55-c803-452a-9db1-fd20fbcc679d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980744d3b38a4ee0be3443d5d223763f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:56Z,use_quota=True,user_id='236620e289d243bdb049423f323c7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe103ee-a2c7-473e-8eb7-08e890f743d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe103ee-a2c7-473e-8eb7-08e890f743d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0918e426-6004-49ba-b38a-47c33c9eaba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0918e426-6004-49ba-b38a-47c33c9eaba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b4fc55-c803-452a-9db1-fd20fbcc679d', 'volume_name': 'volume-19b4fc55-c803-452a-9db1-fd20fbcc679d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aa245b-0e29-44c9-9ae8-eb25f9b4d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aa245b-0e29-44c9-9ae8-eb25f9b4d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d4e2a-9e69-4c5d-a212-13897964b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:56 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Volume 19b4fc55-c803-452a-9db1-fd20fbcc679d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b4fc55-c803-452a-9db1-fd20fbcc679d', 'volume_size': 1} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-805552481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b4fc55-c803-452a-9db1-fd20fbcc679d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980744d3b38a4ee0be3443d5d223763f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:56Z,use_quota=True,user_id='236620e289d243bdb049423f323c7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Creating volume 19b4fc55-c803-452a-9db1-fd20fbcc679d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:56 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:56 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d 1073741824 Sep 28 18:08:56 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:56 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d 1073741824" returned: 0 in 0.886s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:57 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d Sep 28 18:08:57 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:57 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d" returned: 0 in 0.397s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d4e2a-9e69-4c5d-a212-13897964b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b4fc55-c803-452a-9db1-fd20fbcc679d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6281780f-02a7-41ea-aadb-b1638b496467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Volume volume-19b4fc55-c803-452a-9db1-fd20fbcc679d (19b4fc55-c803-452a-9db1-fd20fbcc679d): created successfully Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6281780f-02a7-41ea-aadb-b1638b496467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Flow 'volume_create_manager' (0863aa20-c98e-491a-a4e4-b527f4259fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1750c099-1698-4ec6-b27a-401165671b05 tempest-VolumesListTestJSON-164738871 None] Created volume successfully. Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Flow 'volume_create_manager' (c1c3d34b-ceeb-4c83-b600-cbadcfef236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649a2f1e-81a2-46b6-b50e-22c794b2b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649a2f1e-81a2-46b6-b50e-22c794b2b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2046046269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da96488b-07f1-48a7-9298-2fbc704b262f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980744d3b38a4ee0be3443d5d223763f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:59Z,use_quota=True,user_id='236620e289d243bdb049423f323c7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a342cf7-7f00-4c3d-8210-d71f09522426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a342cf7-7f00-4c3d-8210-d71f09522426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351c4133-aef3-43ae-81bf-451e117708ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351c4133-aef3-43ae-81bf-451e117708ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da96488b-07f1-48a7-9298-2fbc704b262f', 'volume_name': 'volume-da96488b-07f1-48a7-9298-2fbc704b262f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24323ef-d4b1-434a-bda1-897d1ede2f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24323ef-d4b1-434a-bda1-897d1ede2f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3835aa-00e6-4bbd-8de7-795a087df6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:59 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Volume da96488b-07f1-48a7-9298-2fbc704b262f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da96488b-07f1-48a7-9298-2fbc704b262f', 'volume_size': 1} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2046046269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da96488b-07f1-48a7-9298-2fbc704b262f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='980744d3b38a4ee0be3443d5d223763f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:59Z,use_quota=True,user_id='236620e289d243bdb049423f323c7938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Creating volume da96488b-07f1-48a7-9298-2fbc704b262f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:59 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f 1073741824 Sep 28 18:08:59 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f 1073741824" returned: 0 in 0.772s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:00 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f Sep 28 18:09:00 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:00 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f" returned: 0 in 0.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3835aa-00e6-4bbd-8de7-795a087df6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da96488b-07f1-48a7-9298-2fbc704b262f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec021770-4ba7-43eb-b49f-8dd1189f45f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:00 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Volume volume-da96488b-07f1-48a7-9298-2fbc704b262f (da96488b-07f1-48a7-9298-2fbc704b262f): created successfully Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec021770-4ba7-43eb-b49f-8dd1189f45f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Flow 'volume_create_manager' (c1c3d34b-ceeb-4c83-b600-cbadcfef236c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-98275244-74bd-4cb7-9d10-517cc24e3bab tempest-VolumesListTestJSON-164738871 None] Created volume successfully. Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "cinder-da96488b-07f1-48a7-9298-2fbc704b262f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-da96488b-07f1-48a7-9298-2fbc704b262f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "cinder-quobyte-da96488b-07f1-48a7-9298-2fbc704b262f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-quobyte-da96488b-07f1-48a7-9298-2fbc704b262f" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5547ee-b246-4731-8137-75fcbe87e4d5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f Sep 28 18:09:04 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:04 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f" returned: 0 in 0.603s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f Sep 28 18:09:04 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:05 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da96488b-07f1-48a7-9298-2fbc704b262f" returned: 0 in 0.446s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-quobyte-da96488b-07f1-48a7-9298-2fbc704b262f" released by "delete_volume" :: held 1.117s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Created reservations ['58fd389d-e73c-46f8-b61a-be5eb81a7cb3', 'd50cca88-2dc9-4f3f-a7b9-487bec4c0c6d', '292b04a4-e1da-43ba-8a75-77059a1a3894', '11712a95-267b-4668-a5b5-a838de303423'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:05 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:05 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:05 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.427s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:05 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Deleted volume successfully. Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-dc73daf5-534d-4e2d-aa3b-75079da41693 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-da96488b-07f1-48a7-9298-2fbc704b262f-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Flow 'volume_create_manager' (72971a1b-140a-49af-9e20-04187b0349c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9c379f-fa78-48fd-bf47-8a746238aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9c379f-fa78-48fd-bf47-8a746238aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cfc68e-36bd-426f-a2bd-43a8e85d8d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b508dd3449d486f91c0c1ac01285691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:06Z,use_quota=True,user_id='f0646e808e504ea3a3f6708ffdefb6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80901d1b-cf90-4208-9e55-4038cb4f16c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80901d1b-cf90-4208-9e55-4038cb4f16c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7749e9b8-034d-48fa-8334-eb112c9d6996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7749e9b8-034d-48fa-8334-eb112c9d6996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02cfc68e-36bd-426f-a2bd-43a8e85d8d62', 'volume_name': 'volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10bedae-8a46-4d4c-9300-dac13d1a1bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10bedae-8a46-4d4c-9300-dac13d1a1bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063a7ea3-66d9-4215-ab2a-ce999364ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:06 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Volume 02cfc68e-36bd-426f-a2bd-43a8e85d8d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62', 'volume_size': 1} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02cfc68e-36bd-426f-a2bd-43a8e85d8d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b508dd3449d486f91c0c1ac01285691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:06Z,use_quota=True,user_id='f0646e808e504ea3a3f6708ffdefb6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Creating volume 02cfc68e-36bd-426f-a2bd-43a8e85d8d62 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:06 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:06 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 1073741824 Sep 28 18:09:06 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "cinder-19b4fc55-c803-452a-9db1-fd20fbcc679d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-19b4fc55-c803-452a-9db1-fd20fbcc679d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "cinder-quobyte-19b4fc55-c803-452a-9db1-fd20fbcc679d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-quobyte-19b4fc55-c803-452a-9db1-fd20fbcc679d" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e8cc13-15de-461d-a4f0-3c16c6c896bd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:06 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d Sep 28 18:09:06 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:06 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 1073741824" returned: 0 in 0.712s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:07 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 Sep 28 18:09:07 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:07 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d" returned: 0 in 0.645s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:07 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d Sep 28 18:09:07 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:07 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063a7ea3-66d9-4215-ab2a-ce999364ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87009eec-716c-419c-a097-00881f2f4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:07 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Volume volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 (02cfc68e-36bd-426f-a2bd-43a8e85d8d62): created successfully Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87009eec-716c-419c-a097-00881f2f4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Flow 'volume_create_manager' (72971a1b-140a-49af-9e20-04187b0349c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fee8aa43-a56f-4632-a582-02f4af1d2bfc tempest-CinderUnicodeTest-1982494486 None] Created volume successfully. Sep 28 18:09:07 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19b4fc55-c803-452a-9db1-fd20fbcc679d" returned: 0 in 0.329s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-quobyte-19b4fc55-c803-452a-9db1-fd20fbcc679d" released by "delete_volume" :: held 1.040s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Created reservations ['42257017-6d83-4bfb-b0eb-2182bd24e5f7', '111ccbb4-8ebc-4712-a1ed-7ff4c1cec8e0', '14102d43-44bd-440a-936b-5ca1699e71b6', '59db6c22-6fa0-419c-b570-f6d1fd29f0ad'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:07 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:07 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:08 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.409s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Deleted volume successfully. Sep 28 18:09:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95773907-cde8-4596-914f-1516aa064414 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-19b4fc55-c803-452a-9db1-fd20fbcc679d-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "cinder-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Flow 'volume_create_manager' (884e16c6-84e3-49fc-838b-bf271e7d1895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab36c55-8a31-419e-83ba-08ec9ee388f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "cinder-quobyte-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab36c55-8a31-419e-83ba-08ec9ee388f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-234088035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f170a4cf-8540-441f-9e94-e3dbcd8d9f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b508dd3449d486f91c0c1ac01285691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:09Z,use_quota=True,user_id='f0646e808e504ea3a3f6708ffdefb6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e6842c-f93b-4e33-ad03-d14fad8a5195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e6842c-f93b-4e33-ad03-d14fad8a5195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94bd3b75-2ebb-4a69-8acb-92cd7d780f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94bd3b75-2ebb-4a69-8acb-92cd7d780f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f170a4cf-8540-441f-9e94-e3dbcd8d9f49', 'volume_name': 'volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08125df-8ec5-4c5e-956b-7fb06ad93b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08125df-8ec5-4c5e-956b-7fb06ad93b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8643d5f-d6f4-48e8-9ddd-77b3fab2f1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Volume f170a4cf-8540-441f-9e94-e3dbcd8d9f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49', 'volume_size': 1} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-234088035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f170a4cf-8540-441f-9e94-e3dbcd8d9f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b508dd3449d486f91c0c1ac01285691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:09Z,use_quota=True,user_id='f0646e808e504ea3a3f6708ffdefb6c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Creating volume f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:09 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-quobyte-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb" acquired by "delete_volume" :: waited 0.124s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:09 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 1073741824 Sep 28 18:09:09 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[18859555-7afb-4590-aa42-5c7d03ace48c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb Sep 28 18:09:09 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:09 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb" returned: 0 in 0.515s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb Sep 28 18:09:09 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:09 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 1073741824" returned: 0 in 0.693s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 Sep 28 18:09:09 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:10 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb" returned: 0 in 0.383s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-quobyte-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb" released by "delete_volume" :: held 0.979s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Created reservations ['76f11bbe-54be-4aee-a2e5-361dec91c6ee', 'bfe4f820-9e9e-4257-9492-d52b48b56d1c', 'de29a98f-bc96-4089-b7a1-d219b8e3a541', 'ff95512c-368d-4057-9412-c5d1898fdf7e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:10 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" returned: 0 in 0.372s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8643d5f-d6f4-48e8-9ddd-77b3fab2f1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4188bd0-5e83-46d7-8f7d-db3c037e98fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:10 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Volume volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 (f170a4cf-8540-441f-9e94-e3dbcd8d9f49): created successfully Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4188bd0-5e83-46d7-8f7d-db3c037e98fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Flow 'volume_create_manager' (884e16c6-84e3-49fc-838b-bf271e7d1895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-240c0f22-1d6f-4b16-ae70-80169e3ed2b2 tempest-CinderUnicodeTest-1982494486 None] Created volume successfully. Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:10 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:10 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:10 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.304s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Deleted volume successfully. Sep 28 18:09:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-78228990-3111-45bf-a74f-052c35d18928 tempest-VolumesListTestJSON-164738871 None] Lock "cinder-be02b81e-a58e-4fd9-a7f6-cb16adbe9adb-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Creating offline snapshot 49cfd790-3cf3-41fc-aad5-30f2b973bdba of volume f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[77561740-0afd-46ed-8d52-61470e505937]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:11 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 Sep 28 18:09:11 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:12 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" returned: 0 in 0.556s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:12 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba 1G Sep 28 18:09:12 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:12 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba 1G" returned: 0 in 0.763s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:12 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba Sep 28 18:09:12 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:13 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba" returned: 0 in 0.508s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:13 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba is being set with open permissions: ugo+rw Sep 28 18:09:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:13 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba Sep 28 18:09:13 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:13 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:13 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info Sep 28 18:09:13 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:14 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info" returned: 0 in 0.410s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:14 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info is being set with open permissions: ugo+rw Sep 28 18:09:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:14 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info Sep 28 18:09:14 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:14 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.info" returned: 0 in 0.443s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.277s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-be59df89-d3c2-4317-9f3c-242b298b3d23 tempest-CinderUnicodeTest-1982494486 None] Create snapshot completed successfully Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-49cfd790-3cf3-41fc-aad5-30f2b973bdba-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-49cfd790-3cf3-41fc-aad5-30f2b973bdba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-quobyte-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-quobyte-49cfd790-3cf3-41fc-aad5-30f2b973bdba" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-49cfd790-3cf3-41fc-aad5-30f2b973bdba" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Deleting offline snapshot 49cfd790-3cf3-41fc-aad5-30f2b973bdba of volume f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] snapshot_file for this snap is: volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9468017a-838c-437b-9146-921a0a827255]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:16 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba Sep 28 18:09:16 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:16 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba" returned: 0 in 0.646s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b372f4d-a2a7-4579-8a1c-62a1e9ff552b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:16 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 Sep 28 18:09:16 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:17 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Flow 'volume_create_manager' (24636b67-5922-43db-b1d2-43d44bc3e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d30c6cd-13cd-4384-8a18-3f27b7871fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" returned: 0 in 0.750s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:17 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba Sep 28 18:09:17 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d30c6cd-13cd-4384-8a18-3f27b7871fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1400426975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19376794-6dad-460f-aee2-55b495b69820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9bc915daa456d93a7f2bfff7426c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:17Z,use_quota=True,user_id='a8209112e109416c8306644e5f455064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5ee49b-e25b-4af5-8d50-c787069cee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5ee49b-e25b-4af5-8d50-c787069cee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3823815b-c06c-411c-a198-c50fe60f8b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3823815b-c06c-411c-a198-c50fe60f8b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19376794-6dad-460f-aee2-55b495b69820', 'volume_name': 'volume-19376794-6dad-460f-aee2-55b495b69820', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aec4547-84e3-4e88-8ca0-bb264024b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aec4547-84e3-4e88-8ca0-bb264024b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b909cd7-abc7-4147-bf75-878f5173631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:17 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Volume 19376794-6dad-460f-aee2-55b495b69820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19376794-6dad-460f-aee2-55b495b69820', 'volume_size': 1} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1400426975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19376794-6dad-460f-aee2-55b495b69820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9bc915daa456d93a7f2bfff7426c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:17Z,use_quota=True,user_id='a8209112e109416c8306644e5f455064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Creating volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:17 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:17 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 1073741824 Sep 28 18:09:17 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:18 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba" returned: 0 in 0.483s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:18 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba Sep 28 18:09:18 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:18 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49.49cfd790-3cf3-41fc-aad5-30f2b973bdba" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:18 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 1073741824" returned: 0 in 0.775s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-49cfd790-3cf3-41fc-aad5-30f2b973bdba" released by "_delete_snapshot" :: held 2.521s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" released by "delete_snapshot" :: held 2.564s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:18 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 Sep 28 18:09:18 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Created reservations ['fe37d0b9-889c-45fa-9be3-3399f905faf9', '4eb47675-8dc7-4f69-b3c7-ce4926da5e03', '25418adb-9186-4634-904d-6bf2c868b34d', 'f09b08c1-7409-4933-8bc6-6fcd5bffb9a7'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:18 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Delete snapshot completed successfully. Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-07f456a9-e4a5-46db-aa64-238cf882d89e tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-49cfd790-3cf3-41fc-aad5-30f2b973bdba-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:18 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b909cd7-abc7-4147-bf75-878f5173631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19376794-6dad-460f-aee2-55b495b69820', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8086dae-c2c7-4ecc-a47c-22f31f9d5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:18 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Volume volume-19376794-6dad-460f-aee2-55b495b69820 (19376794-6dad-460f-aee2-55b495b69820): created successfully Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8086dae-c2c7-4ecc-a47c-22f31f9d5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Flow 'volume_create_manager' (24636b67-5922-43db-b1d2-43d44bc3e22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:18 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0489cfd7-87f3-4b2a-9903-19019015ddd9 tempest-VolumesSnapshotListTestJSON-442886020 None] Created volume successfully. Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-f170a4cf-8540-441f-9e94-e3dbcd8d9f49-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-f170a4cf-8540-441f-9e94-e3dbcd8d9f49-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-quobyte-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b990cae-a1b7-4501-822a-9c4b55062ee1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:19 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 Sep 28 18:09:19 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Creating offline snapshot e81d1d17-7548-4c53-8af1-5c775ed3cced of volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d06b4-33d7-446d-bb82-d31387f97539]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:20 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 Sep 28 18:09:20 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:20 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" returned: 0 in 0.587s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:20 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49 Sep 28 18:09:20 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:20 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820" returned: 0 in 0.544s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:20 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced 1G Sep 28 18:09:20 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:20 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" returned: 0 in 0.432s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-f170a4cf-8540-441f-9e94-e3dbcd8d9f49" released by "delete_volume" :: held 1.130s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Created reservations ['5131b5b4-42c7-4a4e-8493-2bb84635b655', '8a29e92f-32d9-4b6f-ba68-9f6c0f80636b', '619ff7d1-71c4-4bf0-8487-388b99645516', '8f71c664-e708-4784-8e24-46027d3f418c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:20 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:20 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:21 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced 1G" returned: 0 in 0.674s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.355s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:21 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:21 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:21 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Deleted volume successfully. Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a000d92c-569d-4588-bb7a-94a9c9181aa4 tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-f170a4cf-8540-441f-9e94-e3dbcd8d9f49-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:21 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 0.373s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:21 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced is being set with open permissions: ugo+rw Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:21 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-02cfc68e-36bd-426f-a2bd-43a8e85d8d62-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-02cfc68e-36bd-426f-a2bd-43a8e85d8d62-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "cinder-quobyte-02cfc68e-36bd-426f-a2bd-43a8e85d8d62" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-02cfc68e-36bd-426f-a2bd-43a8e85d8d62" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa2046-739b-4308-a96d-c330e27c17e8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 Sep 28 18:09:21 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:21 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info Sep 28 18:09:21 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:22 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info" returned: 0 in 0.365s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info is being set with open permissions: ugo+rw Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:22 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62" returned: 0 in 0.554s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:22 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info Sep 28 18:09:22 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:22 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62 Sep 28 18:09:22 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:22 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.info" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:22 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02cfc68e-36bd-426f-a2bd-43a8e85d8d62" returned: 0 in 0.331s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-quobyte-02cfc68e-36bd-426f-a2bd-43a8e85d8d62" released by "delete_volume" :: held 0.957s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:22 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a13d391b-5e0c-4a64-887c-ef5e65ac9469 tempest-VolumesSnapshotListTestJSON-442886020 None] Create snapshot completed successfully Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Created reservations ['075e2302-5f30-431e-9db2-771194e2c170', '8fd2aa98-7305-46f8-8619-85b48582ab66', 'fb68748e-56a9-4c04-9dd1-b500bf46a331', 'b31f4253-f407-49c3-bcbe-7dca06b8fa08'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:22 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:22 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Creating offline snapshot 49ff027b-9c66-42db-b7af-05a9e3def320 of volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:23 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.417s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Deleted volume successfully. Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[af387935-bf61-4063-b66a-2b75414c7687]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-304a82cd-08c5-43bc-b4fb-1048a9270b2a tempest-CinderUnicodeTest-1982494486 None] Lock "cinder-02cfc68e-36bd-426f-a2bd-43a8e85d8d62-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:23 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:23 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:23 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:23 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:23 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 0.513s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:23 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 1G Sep 28 18:09:23 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:24 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.625s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:09:24 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 1G" returned: 0 in 1.029s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:24 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:24 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:25 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.536s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:25 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 is being set with open permissions: ugo+rw Sep 28 18:09:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:25 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:25 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:25 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.375s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:25 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6f480098-cbdd-4ebf-b14e-1a4f50cc5794 tempest-VolumesSnapshotListTestJSON-442886020 None] Create snapshot completed successfully Sep 28 18:09:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Creating offline snapshot 15397d29-c4ca-4d72-85c4-88432151c2d9 of volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:26 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e0f768-b704-4e88-bc81-bfd298fb7be0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:27 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:27 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:27 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.606s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:27 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:27 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 1G Sep 28 18:09:27 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:28 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 1G" returned: 0 in 0.854s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:28 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 Sep 28 18:09:28 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:28 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9" returned: 0 in 0.440s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:28 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 is being set with open permissions: ugo+rw Sep 28 18:09:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:28 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 Sep 28 18:09:28 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:29 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9" returned: 0 in 0.347s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8b12e62d-b2ad-4de0-a995-8df5a5191769 tempest-VolumesSnapshotListTestJSON-442886020 None] Create snapshot completed successfully Sep 28 18:09:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-15397d29-c4ca-4d72-85c4-88432151c2d9-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-15397d29-c4ca-4d72-85c4-88432151c2d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-15397d29-c4ca-4d72-85c4-88432151c2d9" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-15397d29-c4ca-4d72-85c4-88432151c2d9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Deleting offline snapshot 15397d29-c4ca-4d72-85c4-88432151c2d9 of volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] snapshot_file for this snap is: volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ac9d0d-c9e2-4848-b480-b92e274f7ee7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:32 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 Sep 28 18:09:32 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9" returned: 0 in 0.868s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:33 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[948a7014-ee8b-4b8e-adcb-f26175f56a42]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:33 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:33 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.556s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:33 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 Sep 28 18:09:33 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:34 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9" returned: 0 in 0.878s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:34 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9 Sep 28 18:09:34 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:34 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.15397d29-c4ca-4d72-85c4-88432151c2d9" returned: 0 in 0.509s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-15397d29-c4ca-4d72-85c4-88432151c2d9" released by "_delete_snapshot" :: held 3.071s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" released by "delete_snapshot" :: held 3.119s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:35 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Created reservations ['d7eed74e-e7b2-40c7-bf77-fa0b55a7aaa9', '31eb4c62-1bf3-461b-b55c-60a601225401', '569c44e6-448f-4ff4-a5e9-5694d55d72c2', '1c7318db-f132-4fd3-b081-df35012b4ab1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Delete snapshot completed successfully. Sep 28 18:09:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bd09c34c-79db-4d26-861c-0ca4395b6bcd tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-15397d29-c4ca-4d72-85c4-88432151c2d9-delete_snapshot" released by "delete_snapshot" :: held 3.471s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-49ff027b-9c66-42db-b7af-05a9e3def320-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-49ff027b-9c66-42db-b7af-05a9e3def320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-49ff027b-9c66-42db-b7af-05a9e3def320" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-49ff027b-9c66-42db-b7af-05a9e3def320" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Deleting offline snapshot 49ff027b-9c66-42db-b7af-05a9e3def320 of volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] snapshot_file for this snap is: volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea24ec-2e43-4ad5-92dc-e9ca823bb75e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:36 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:36 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Flow 'volume_create_manager' (8c03f863-a4c3-49b3-a2be-097f81171d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557a9801-e2b4-4c88-b046-ac641b12c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557a9801-e2b4-4c88-b046-ac641b12c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1509397715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bdaee9-c272-4dab-a67a-9539b49e6903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c58788ae13444bbb32c8845cfb6852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:37Z,use_quota=True,user_id='b81fad8c88e74a08b27030aece4e0df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8634b03-333c-4eda-aaa4-e209cf92bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8634b03-333c-4eda-aaa4-e209cf92bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85676d92-a6c3-421a-b54a-59923df7e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85676d92-a6c3-421a-b54a-59923df7e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bdaee9-c272-4dab-a67a-9539b49e6903', 'volume_name': 'volume-f8bdaee9-c272-4dab-a67a-9539b49e6903', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7af0b66-ba5e-4b1f-8f01-f4779bfa2e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7af0b66-ba5e-4b1f-8f01-f4779bfa2e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0672675d-9fcf-416c-9172-c58507c0b925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Volume f8bdaee9-c272-4dab-a67a-9539b49e6903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bdaee9-c272-4dab-a67a-9539b49e6903', 'volume_size': 1} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1509397715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bdaee9-c272-4dab-a67a-9539b49e6903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c58788ae13444bbb32c8845cfb6852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:37Z,use_quota=True,user_id='b81fad8c88e74a08b27030aece4e0df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Creating volume f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 1073741824 Sep 28 18:09:37 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a65f1f3-2b53-4186-b48e-28c6a07a7b2e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:37 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 0.624s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 1073741824" returned: 0 in 0.837s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:37 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:09:37 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:38 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0672675d-9fcf-416c-9172-c58507c0b925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bdaee9-c272-4dab-a67a-9539b49e6903', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefb5bd8-efc4-4480-b34f-feee7428d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:38 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Volume volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 (f8bdaee9-c272-4dab-a67a-9539b49e6903): created successfully Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefb5bd8-efc4-4480-b34f-feee7428d98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Flow 'volume_create_manager' (8c03f863-a4c3-49b3-a2be-097f81171d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1589d79e-a7ec-47f0-a281-0215885d082a tempest-VolumesDeleteCascade-1275648662 None] Created volume successfully. Sep 28 18:09:38 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.681s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:38 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320 Sep 28 18:09:38 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:39 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.49ff027b-9c66-42db-b7af-05a9e3def320" returned: 0 in 0.561s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-49ff027b-9c66-42db-b7af-05a9e3def320" released by "_delete_snapshot" :: held 2.680s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" released by "delete_snapshot" :: held 2.725s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Created reservations ['84e1d578-0536-41d7-a5b4-c6962f5679ac', 'f997afcc-8f79-42ce-83c7-79956a4f95c8', 'e65fcd3e-4dae-462a-92e3-2388b33cf27d', '10c8f5cd-d2c8-4e5b-9e29-93185a6de136'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (42cc4c76-e56d-4ed6-af11-1f051bd57a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f827ae3d-5102-4482-b340-46c6527c6c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Delete snapshot completed successfully. Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f827ae3d-5102-4482-b340-46c6527c6c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1806089572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aa804a-9d03-4a15-a006-b5929f17ce77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:39Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca18e655-3aa7-439e-bef1-9efc5ccaa85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca18e655-3aa7-439e-bef1-9efc5ccaa85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ddf4b9-b1d0-42ef-8a3e-6e56935d713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ddf4b9-b1d0-42ef-8a3e-6e56935d713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50aa804a-9d03-4a15-a006-b5929f17ce77', 'volume_name': 'volume-50aa804a-9d03-4a15-a006-b5929f17ce77', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31dbd41-5818-4009-8c66-67fe7d73bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31dbd41-5818-4009-8c66-67fe7d73bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb2a6d6-4006-4760-995c-b50cd7787703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Volume 50aa804a-9d03-4a15-a006-b5929f17ce77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50aa804a-9d03-4a15-a006-b5929f17ce77', 'volume_size': 1} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1806089572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50aa804a-9d03-4a15-a006-b5929f17ce77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:39Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Creating volume 50aa804a-9d03-4a15-a006-b5929f17ce77 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:39 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-77ad43a4-da92-4a53-8e25-c45af77d6364 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-49ff027b-9c66-42db-b7af-05a9e3def320-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:39 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 1073741824 Sep 28 18:09:39 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-e81d1d17-7548-4c53-8af1-5c775ed3cced-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-e81d1d17-7548-4c53-8af1-5c775ed3cced-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-e81d1d17-7548-4c53-8af1-5c775ed3cced" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-e81d1d17-7548-4c53-8af1-5c775ed3cced" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Deleting offline snapshot e81d1d17-7548-4c53-8af1-5c775ed3cced of volume 19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] snapshot_file for this snap is: volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[54acbc2f-8464-45eb-a217-654406f84ee4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:40 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:40 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:40 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 1073741824" returned: 0 in 1.157s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:40 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 Sep 28 18:09:40 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:41 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 1.017s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19376794-6dad-460f-aee2-55b495b69820(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d151f-f880-4c43-81dd-5d0fce6b54f2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:41 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77" returned: 0 in 0.516s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.767s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb2a6d6-4006-4760-995c-b50cd7787703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50aa804a-9d03-4a15-a006-b5929f17ce77', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1f9d63-254c-4b6b-958c-70079b2030ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Creating offline snapshot 3269861e-170f-4258-9ce1-e4ce18fc9daf of volume f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Volume volume-50aa804a-9d03-4a15-a006-b5929f17ce77 (50aa804a-9d03-4a15-a006-b5929f17ce77): created successfully Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1f9d63-254c-4b6b-958c-70079b2030ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (42cc4c76-e56d-4ed6-af11-1f051bd57a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:41 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 Sep 28 18:09:41 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c33701-669d-4d29-858f-eaa318d0d8ff]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7c6aa6a2-68b7-4f93-82b1-44a6a59ae1f6 tempest-ProjectReaderTests-56794737 None] Created volume successfully. Sep 28 18:09:41 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:09:41 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:42 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820" returned: 0 in 0.802s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:42 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:42 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:42 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.703s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:42 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf 1G Sep 28 18:09:42 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:42 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:42 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced Sep 28 18:09:42 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-50aa804a-9d03-4a15-a006-b5929f17ce77-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Lock "cinder-50aa804a-9d03-4a15-a006-b5929f17ce77-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:43 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf 1G" returned: 0 in 0.818s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-quobyte-50aa804a-9d03-4a15-a006-b5929f17ce77" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:43 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820.e81d1d17-7548-4c53-8af1-5c775ed3cced" returned: 0 in 0.553s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:43 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-50aa804a-9d03-4a15-a006-b5929f17ce77" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:43 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe00a1c-f91c-42d1-8991-6751c18ecf57]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-e81d1d17-7548-4c53-8af1-5c775ed3cced" released by "_delete_snapshot" :: held 3.241s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" released by "delete_snapshot" :: held 3.323s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Created reservations ['20ca88f5-5097-48d7-a01d-4071caaa86ce', '3cca4f97-dcb0-4c6b-89ef-11afbb8f08f7', '13d610be-37a0-4a99-b937-a678501cf1e9', '1f059f0e-0586-49e6-a80c-15e8724f9846'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:43 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 Sep 28 18:09:43 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Delete snapshot completed successfully. Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-99d408fe-e1ff-465d-b16a-a6023758bc05 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-e81d1d17-7548-4c53-8af1-5c775ed3cced-delete_snapshot" released by "delete_snapshot" :: held 3.699s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:43 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.747s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:43 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf is being set with open permissions: ugo+rw Sep 28 18:09:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:43 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:43 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:44 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77" returned: 0 in 0.794s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.301s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:44 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77 Sep 28 18:09:44 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info Sep 28 18:09:44 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:44 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-50aa804a-9d03-4a15-a006-b5929f17ce77" returned: 0 in 0.339s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-50aa804a-9d03-4a15-a006-b5929f17ce77" released by "delete_volume" :: held 1.295s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-19376794-6dad-460f-aee2-55b495b69820-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:44 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info" returned: 0 in 0.423s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:44 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info is being set with open permissions: ugo+rw Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-19376794-6dad-460f-aee2-55b495b69820-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:44 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info Sep 28 18:09:44 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Created reservations ['9ed73716-decb-4aa1-b8e9-2d0c3f6bddf8', '4a393008-8929-4672-b2d2-79b08ac42e96', 'c01e86e0-16e3-428e-8d62-a24efe4658f6', 'b97a50d3-6fcf-49c7-a2aa-5d760a0ebb1a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" acquired by "delete_volume" :: waited 0.043s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7de057-22a0-4f89-9fb3-bc399f393eb8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:44 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:44 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:45 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 Sep 28 18:09:45 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:45 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.info" returned: 0 in 0.560s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.831s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fba5bfab-f2cb-48fc-abe0-49ccae2176d4 tempest-VolumesDeleteCascade-1275648662 None] Create snapshot completed successfully Sep 28 18:09:45 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.494s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Deleted volume successfully. Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-79fc7a31-c9e7-45fc-afd6-81bd2829dbe6 tempest-ProjectReaderTests-56794737 None] Lock "cinder-50aa804a-9d03-4a15-a006-b5929f17ce77-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:45 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820" returned: 0 in 0.935s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:45 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820 Sep 28 18:09:45 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:46 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (5052adcc-2e13-4036-8f67-57105f2ee6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e9681b-b934-474a-91a7-ae8ffe558d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-19376794-6dad-460f-aee2-55b495b69820" returned: 0 in 0.651s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e9681b-b934-474a-91a7-ae8ffe558d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271399585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766f8505-1703-49e0-a1ef-1db1fea5a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:46Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3a5e58-12dc-4cbc-b3ed-c63a06efca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3a5e58-12dc-4cbc-b3ed-c63a06efca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d74c16c-ba1c-4aa8-a1eb-5a9a84b9a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d74c16c-ba1c-4aa8-a1eb-5a9a84b9a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766f8505-1703-49e0-a1ef-1db1fea5a190', 'volume_name': 'volume-766f8505-1703-49e0-a1ef-1db1fea5a190', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a753e046-92f3-41dd-b3e0-7e317a2e6eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a753e046-92f3-41dd-b3e0-7e317a2e6eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e428066-77e1-425e-a216-6f5a3cb22ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:46 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Volume 766f8505-1703-49e0-a1ef-1db1fea5a190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766f8505-1703-49e0-a1ef-1db1fea5a190', 'volume_size': 1} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271399585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766f8505-1703-49e0-a1ef-1db1fea5a190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:46Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Creating volume 766f8505-1703-49e0-a1ef-1db1fea5a190 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:46 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-quobyte-19376794-6dad-460f-aee2-55b495b69820" released by "delete_volume" :: held 1.825s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:46 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 1073741824 Sep 28 18:09:46 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Created reservations ['bc53d2fe-8a09-4f3f-8bc9-647af9154abe', 'c6272f8c-34aa-44a8-af4c-bee388c94d71', '865a7b32-7e6b-4b1f-862c-aee7d008b2ca', '86db51fc-6215-40f8-8cf0-331e0744b507'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:47 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:47 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:47 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.519s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:47 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Deleted volume successfully. Sep 28 18:09:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-137d1a7d-34b2-4fd5-aa88-0e1851e18168 tempest-VolumesSnapshotListTestJSON-442886020 None] Lock "cinder-19376794-6dad-460f-aee2-55b495b69820-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:47 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 1073741824" returned: 0 in 0.989s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:47 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 Sep 28 18:09:47 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:48 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190" returned: 0 in 0.465s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.463s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e428066-77e1-425e-a216-6f5a3cb22ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766f8505-1703-49e0-a1ef-1db1fea5a190', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b110b66b-a18f-41f7-94a1-335ee4b85830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Creating offline snapshot 37019707-b78d-4ecd-b33d-b1678d298bb3 of volume f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:48 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Volume volume-766f8505-1703-49e0-a1ef-1db1fea5a190 (766f8505-1703-49e0-a1ef-1db1fea5a190): created successfully Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b110b66b-a18f-41f7-94a1-335ee4b85830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (5052adcc-2e13-4036-8f67-57105f2ee6bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa7a73-d153-4531-827c-819a7b1f4740]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-26128923-5fe1-450f-97c5-570400acb87d tempest-ProjectReaderTests-56794737 None] Created volume successfully. Sep 28 18:09:48 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:48 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-766f8505-1703-49e0-a1ef-1db1fea5a190-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Lock "cinder-766f8505-1703-49e0-a1ef-1db1fea5a190-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-quobyte-766f8505-1703-49e0-a1ef-1db1fea5a190" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-766f8505-1703-49e0-a1ef-1db1fea5a190" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[423b8155-5c36-4b6f-89c6-e9d8f21dac9a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:49 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.776s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bdaee9-c272-4dab-a67a-9539b49e6903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:49 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 1G Sep 28 18:09:49 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:49 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 Sep 28 18:09:49 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:49 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190" returned: 0 in 0.543s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:49 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190 Sep 28 18:09:49 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:49 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 1G" returned: 0 in 0.627s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:49 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 Sep 28 18:09:49 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:49 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-766f8505-1703-49e0-a1ef-1db1fea5a190" returned: 0 in 0.388s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-766f8505-1703-49e0-a1ef-1db1fea5a190" released by "delete_volume" :: held 1.071s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Created reservations ['3eca8291-8fc3-4ad4-85ca-d4f6dd7bbfc3', '3f82e018-a7f9-4b30-962c-919eba8d0cbe', 'b1ec8247-4dff-46ea-8339-ad4ab9e7850b', '4a93c74a-74ad-4f56-a876-d136ea2b6b2e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:50 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:50 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:50 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3" returned: 0 in 0.585s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:50 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 is being set with open permissions: ugo+rw Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:50 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 Sep 28 18:09:50 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:50 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.404s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Deleted volume successfully. Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=116,cinder:INSERT=32,cinder:UPDATE=147,cinder:DELETE=12 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:50 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3" returned: 0 in 0.371s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=143,cinder:SELECT=100,cinder:DELETE=14,cinder:INSERT=40 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8c2db531-ec21-40eb-9e8e-765fae7b7ff2 tempest-ProjectReaderTests-56794737 None] Lock "cinder-766f8505-1703-49e0-a1ef-1db1fea5a190-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8fe87c9d-e877-42cf-9ee5-ba1752d87121 tempest-VolumesDeleteCascade-1275648662 None] Create snapshot completed successfully Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (3997acae-0c85-49d3-9bfa-0e329dad9e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd245578-3713-4471-a954-3465e6319745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd245578-3713-4471-a954-3465e6319745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483606820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040f45e7-8a39-4058-b1a8-accab90362a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:52Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e85d1c-969d-493f-991f-e083a4e763e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e85d1c-969d-493f-991f-e083a4e763e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356ec8e2-4629-40c3-a3ac-7a3fc09621e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356ec8e2-4629-40c3-a3ac-7a3fc09621e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040f45e7-8a39-4058-b1a8-accab90362a4', 'volume_name': 'volume-040f45e7-8a39-4058-b1a8-accab90362a4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a93b0b-472d-4a41-a078-3c83ac5f1130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a93b0b-472d-4a41-a078-3c83ac5f1130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534fe9e8-51f3-437d-9cea-7b913ac6f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Volume 040f45e7-8a39-4058-b1a8-accab90362a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040f45e7-8a39-4058-b1a8-accab90362a4', 'volume_size': 1} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483606820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040f45e7-8a39-4058-b1a8-accab90362a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:52Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Creating volume 040f45e7-8a39-4058-b1a8-accab90362a4 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:52 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 1073741824 Sep 28 18:09:52 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-f8bdaee9-c272-4dab-a67a-9539b49e6903-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-f8bdaee9-c272-4dab-a67a-9539b49e6903-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Performing cascade delete. {{(pid=87096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-3269861e-170f-4258-9ce1-e4ce18fc9daf-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-3269861e-170f-4258-9ce1-e4ce18fc9daf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-3269861e-170f-4258-9ce1-e4ce18fc9daf" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-3269861e-170f-4258-9ce1-e4ce18fc9daf" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Deleting offline snapshot 3269861e-170f-4258-9ce1-e4ce18fc9daf of volume f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] snapshot_file for this snap is: volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5710a6-0716-4407-bdcc-5d71b13ce26c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:52 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:52 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 1073741824" returned: 0 in 0.781s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 Sep 28 18:09:52 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:53 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.695s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bdaee9-c272-4dab-a67a-9539b49e6903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[92073105-5ec0-4596-8ea0-00fab1788154]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:53 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:09:53 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:53 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4" returned: 0 in 0.641s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534fe9e8-51f3-437d-9cea-7b913ac6f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040f45e7-8a39-4058-b1a8-accab90362a4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153c14ed-a12c-4652-b3e6-afdfd3446234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Volume volume-040f45e7-8a39-4058-b1a8-accab90362a4 (040f45e7-8a39-4058-b1a8-accab90362a4): created successfully Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153c14ed-a12c-4652-b3e6-afdfd3446234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (3997acae-0c85-49d3-9bfa-0e329dad9e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3d967905-b62a-40e1-821c-91339d27ce4b tempest-ProjectReaderTests-56794737 None] Created volume successfully. Sep 28 18:09:53 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.650s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78d010-481b-4a13-99fe-81755d39afc6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-040f45e7-8a39-4058-b1a8-accab90362a4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Lock "cinder-040f45e7-8a39-4058-b1a8-accab90362a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-quobyte-040f45e7-8a39-4058-b1a8-accab90362a4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:54 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 Sep 28 18:09:54 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-040f45e7-8a39-4058-b1a8-accab90362a4" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb18bf-55ae-4e98-8813-1de9a37ad876]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:54 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 Sep 28 18:09:54 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:54 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3" returned: 0 in 0.771s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bdaee9-c272-4dab-a67a-9539b49e6903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9fa674-0ea4-4ca0-917b-b77c12051689]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:55 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4" returned: 0 in 0.620s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:55 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4 Sep 28 18:09:55 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:55 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:55 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:55 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-040f45e7-8a39-4058-b1a8-accab90362a4" returned: 0 in 0.358s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-040f45e7-8a39-4058-b1a8-accab90362a4" released by "delete_volume" :: held 1.059s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:55 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.575s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bdaee9-c272-4dab-a67a-9539b49e6903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b0396a-9b64-4607-941c-8e0c748fd75c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Created reservations ['78596bbe-59d9-40ff-abfd-0dd74f98fd32', '1887156c-c0b8-4a13-9af8-059d90bfe76b', 'c4e86085-3df1-4379-8c00-6b7c29fc6cb6', 'c0b35576-7002-4086-b552-3b31754dabc2'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:55 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:09:55 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:55 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:09:55 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:56 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.569s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:56 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:56 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:56 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.467s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Deleted volume successfully. Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b08e23d2-0cbb-4772-8f47-5e41e55de99b tempest-ProjectReaderTests-56794737 None] Lock "cinder-040f45e7-8a39-4058-b1a8-accab90362a4-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:56 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.637s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:56 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf Sep 28 18:09:56 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:57 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.3269861e-170f-4258-9ce1-e4ce18fc9daf" returned: 0 in 0.497s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 -F qcow2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:57 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 -F qcow2 Sep 28 18:09:57 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (a30c3674-1422-4de1-b208-14891b5ac7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91b0581-096e-4b6b-b413-3f8ebfafe513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91b0581-096e-4b6b-b413-3f8ebfafe513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330248500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf1e714-1350-41eb-b9d7-942d72c4dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:58Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d340525-2995-4bd8-a64c-d397ece099af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d340525-2995-4bd8-a64c-d397ece099af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d995dd-9f85-40cd-9901-a6a7861c8931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d995dd-9f85-40cd-9901-a6a7861c8931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf1e714-1350-41eb-b9d7-942d72c4dc14', 'volume_name': 'volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0a0f8e-4ec9-419d-82a4-6c0fefbc3163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0a0f8e-4ec9-419d-82a4-6c0fefbc3163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e3f9ca-b88c-4a02-b5f1-d5e3f64a3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Volume 2cf1e714-1350-41eb-b9d7-942d72c4dc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14', 'volume_size': 1} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330248500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf1e714-1350-41eb-b9d7-942d72c4dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e71df94ff7841f38c78d140323acdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:58Z,use_quota=True,user_id='96562e7d6b3c45ddb0c76f3fbbb48685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Creating volume 2cf1e714-1350-41eb-b9d7-942d72c4dc14 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:57 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:09:57 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 -F qcow2" returned: 0 in 0.742s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:57 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 1073741824 Sep 28 18:09:57 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-3269861e-170f-4258-9ce1-e4ce18fc9daf" released by "_delete_snapshot" :: held 5.593s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" released by "delete_snapshot" :: held 5.657s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Created reservations ['1b396fdd-2bc6-4b97-bb1e-b24baf8c42c2', '46cc8cdc-94b8-45e0-a43b-de59e8d5e100', '47fa2c72-b844-4a56-af99-7afb47d8bf02', 'f8d05c39-3c2b-449c-8af9-3ceaff4525a8'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Delete snapshot completed successfully. Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-3269861e-170f-4258-9ce1-e4ce18fc9daf-delete_snapshot" released by "delete_snapshot" :: held 5.917s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-37019707-b78d-4ecd-b33d-b1678d298bb3-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-37019707-b78d-4ecd-b33d-b1678d298bb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-37019707-b78d-4ecd-b33d-b1678d298bb3" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-37019707-b78d-4ecd-b33d-b1678d298bb3" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Deleting offline snapshot 37019707-b78d-4ecd-b33d-b1678d298bb3 of volume f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] snapshot_file for this snap is: volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae4e60a-a308-4393-b263-6b1ccb7ce589]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:58 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 Sep 28 18:09:58 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:58 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 1073741824" returned: 0 in 0.768s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:58 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 Sep 28 18:09:58 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:59 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3" returned: 0 in 0.591s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8bdaee9-c272-4dab-a67a-9539b49e6903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2139b-6613-4e70-8345-8e748e3cd223]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:59 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14" returned: 0 in 0.377s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e3f9ca-b88c-4a02-b5f1-d5e3f64a3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194b6c83-0bd0-47b4-ba52-02c81ef4a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:59 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Volume volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 (2cf1e714-1350-41eb-b9d7-942d72c4dc14): created successfully Sep 28 18:09:59 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:09:59 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194b6c83-0bd0-47b4-ba52-02c81ef4a177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Flow 'volume_create_manager' (a30c3674-1422-4de1-b208-14891b5ac7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3aaea2ac-06e2-48b6-95e9-1becf573f0ea tempest-ProjectReaderTests-56794737 None] Created volume successfully. Sep 28 18:09:59 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.577s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:59 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 Sep 28 18:09:59 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-2cf1e714-1350-41eb-b9d7-942d72c4dc14-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Lock "cinder-2cf1e714-1350-41eb-b9d7-942d72c4dc14-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Acquiring lock "cinder-quobyte-2cf1e714-1350-41eb-b9d7-942d72c4dc14" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-2cf1e714-1350-41eb-b9d7-942d72c4dc14" acquired by "delete_volume" :: waited 0.047s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6a96e-99eb-4c94-a023-a4a817e1fd2a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:00 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 Sep 28 18:10:00 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:00 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3" returned: 0 in 0.618s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:00 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3 Sep 28 18:10:00 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:00 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14" returned: 0 in 0.594s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:00 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14 Sep 28 18:10:00 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:00 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903.37019707-b78d-4ecd-b33d-b1678d298bb3" returned: 0 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-37019707-b78d-4ecd-b33d-b1678d298bb3" released by "_delete_snapshot" :: held 2.461s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" released by "delete_snapshot" :: held 2.538s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:00 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Created reservations ['9751a4ca-7d65-44e7-87f4-a414fda0e8c5', '5fac7196-3e84-4d76-82dc-58818c63ff7c', '8e67aa64-1226-4918-ae77-e2a2863a05e7', '78d3b946-221e-49b9-ad64-bf86cc8b9206'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:01 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2cf1e714-1350-41eb-b9d7-942d72c4dc14" returned: 0 in 0.392s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Lock "cinder-quobyte-2cf1e714-1350-41eb-b9d7-942d72c4dc14" released by "delete_volume" :: held 1.056s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Delete snapshot completed successfully. Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-37019707-b78d-4ecd-b33d-b1678d298bb3-delete_snapshot" released by "delete_snapshot" :: held 2.872s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Snapshots deleted, issuing volume delete {{(pid=87096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Created reservations ['01170db7-89c6-4e01-8112-478fe1e07b01', '2b18ce66-f21d-475b-b885-d0050738111b', '5187408f-31c5-4172-989f-8da69787b8d4', '0419de7e-5bfc-4905-b74a-56d9cacc798d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3a48a-d931-46a1-b163-01169e40eaf2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:01 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:10:01 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:01 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:10:01 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:01 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.335s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Deleted volume successfully. Sep 28 18:10:01 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.512s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97398d72-1051-4616-818d-29e9ce910490 tempest-ProjectReaderTests-56794737 None] Lock "cinder-2cf1e714-1350-41eb-b9d7-942d72c4dc14-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:01 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903 Sep 28 18:10:01 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:02 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f8bdaee9-c272-4dab-a67a-9539b49e6903" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-f8bdaee9-c272-4dab-a67a-9539b49e6903" released by "delete_volume" :: held 0.938s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Created reservations ['418761ed-6e53-4bea-83ca-4a955d1c978f', 'f44aff9a-b658-4274-a3ce-d3333183c325', '94ccec31-6aa9-4279-804a-a80f93e0b6ac', '1d561c6a-6fc5-4957-bfb6-ba25c22c45cc'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:02 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:10:02 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:02 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.443s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Deleted volume successfully. Sep 28 18:10:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-fa7ae560-3447-4d64-9d8a-1d466a472635 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-f8bdaee9-c272-4dab-a67a-9539b49e6903-delete_volume" released by "delete_volume" :: held 10.668s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Flow 'volume_create_manager' (f8b107aa-7401-4179-89ca-f3e4a0b89964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee87e30-b94c-4c9a-a8d7-67e6b0806383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee87e30-b94c-4c9a-a8d7-67e6b0806383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1164986634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db916089-ff1f-4bb6-b0f7-80d7ba88c3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c58788ae13444bbb32c8845cfb6852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:04Z,use_quota=True,user_id='b81fad8c88e74a08b27030aece4e0df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24a7e21-2ce1-4508-b3f0-1ffb827100cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24a7e21-2ce1-4508-b3f0-1ffb827100cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85669df4-6e32-4e56-be86-9fa28d1ccd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85669df4-6e32-4e56-be86-9fa28d1ccd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db916089-ff1f-4bb6-b0f7-80d7ba88c3a4', 'volume_name': 'volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfd93df-a254-427e-9861-b49f8621c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfd93df-a254-427e-9861-b49f8621c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d260ec-bf67-49c4-be28-196b6edff677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:04 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Volume db916089-ff1f-4bb6-b0f7-80d7ba88c3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4', 'volume_size': 1} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1164986634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db916089-ff1f-4bb6-b0f7-80d7ba88c3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c58788ae13444bbb32c8845cfb6852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:04Z,use_quota=True,user_id='b81fad8c88e74a08b27030aece4e0df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Creating volume db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:04 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:04 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 1073741824 Sep 28 18:10:04 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:04 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 1073741824" returned: 0 in 0.739s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:04 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 Sep 28 18:10:04 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:05 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d260ec-bf67-49c4-be28-196b6edff677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5384598f-c932-455e-a1ea-1c0fda1b9ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Volume volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 (db916089-ff1f-4bb6-b0f7-80d7ba88c3a4): created successfully Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5384598f-c932-455e-a1ea-1c0fda1b9ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Flow 'volume_create_manager' (f8b107aa-7401-4179-89ca-f3e4a0b89964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3284b30b-adad-4d58-881d-99d955205818 tempest-VolumesDeleteCascade-1275648662 None] Created volume successfully. Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Creating offline snapshot 2bfd16a6-3a77-4746-8954-5017e4b127dc of volume db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984e247-e893-4398-aa67-d9ec2f1cc568]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:06 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 Sep 28 18:10:06 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:06 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" returned: 0 in 0.473s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:06 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc 1G Sep 28 18:10:06 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:07 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc 1G" returned: 0 in 0.848s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:07 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc Sep 28 18:10:07 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:08 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc" returned: 0 in 0.506s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:08 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc is being set with open permissions: ugo+rw Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:08 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc Sep 28 18:10:08 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Flow 'volume_create_manager' (8d2c8ebf-6e8a-4650-8de1-1cd4cc6a3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba8e489-35a2-4b6f-8310-341871794732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba8e489-35a2-4b6f-8310-341871794732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1369121681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27505c41-cb09-4bad-ae11-22defef7db31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1a42c8098c4edbbf3b6d1bcf8a1aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:08Z,use_quota=True,user_id='974cacc440a94dc890fd721c19278973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40641a5-744d-4a46-bbb2-196bf950bed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40641a5-744d-4a46-bbb2-196bf950bed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82e28e0-1dbf-48ec-ab98-5ef18c5d870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82e28e0-1dbf-48ec-ab98-5ef18c5d870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27505c41-cb09-4bad-ae11-22defef7db31', 'volume_name': 'volume-27505c41-cb09-4bad-ae11-22defef7db31', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee74ce5-b4c5-4f41-93b4-c7c5cdd3ad94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee74ce5-b4c5-4f41-93b4-c7c5cdd3ad94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4071ec-bf7e-40ca-a378-d085890ad7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:08 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Volume 27505c41-cb09-4bad-ae11-22defef7db31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27505c41-cb09-4bad-ae11-22defef7db31', 'volume_size': 1} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:08 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc" returned: 0 in 0.397s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:08 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info Sep 28 18:10:08 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:08 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info" returned: 0 in 0.428s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:08 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info is being set with open permissions: ugo+rw Sep 28 18:10:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:08 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info Sep 28 18:10:08 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:09 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.info" returned: 0 in 0.323s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1369121681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27505c41-cb09-4bad-ae11-22defef7db31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c1a42c8098c4edbbf3b6d1bcf8a1aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:08Z,use_quota=True,user_id='974cacc440a94dc890fd721c19278973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Creating volume 27505c41-cb09-4bad-ae11-22defef7db31 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:09 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 1073741824 Sep 28 18:10:09 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a4b58184-72fc-4c1c-8086-a80e884bb6f0 tempest-VolumesDeleteCascade-1275648662 None] Create snapshot completed successfully Sep 28 18:10:09 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 1073741824" returned: 0 in 0.575s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 Sep 28 18:10:09 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:10 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31" returned: 0 in 0.350s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4071ec-bf7e-40ca-a378-d085890ad7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27505c41-cb09-4bad-ae11-22defef7db31', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cbd18b-7e39-455d-81ff-69e03fc0bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:10 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Volume volume-27505c41-cb09-4bad-ae11-22defef7db31 (27505c41-cb09-4bad-ae11-22defef7db31): created successfully Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cbd18b-7e39-455d-81ff-69e03fc0bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Flow 'volume_create_manager' (8d2c8ebf-6e8a-4650-8de1-1cd4cc6a3abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-55342d31-cd8b-4f42-b65f-976fb5b2640f tempest-AttachVolumeShelveTestJSON-753631210 None] Created volume successfully. Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Flow 'volume_create_manager' (5e1f84b6-a251-45a7-a4a1-b82feec57c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24ffd8c-a497-4c91-9171-55a90a0a03b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24ffd8c-a497-4c91-9171-55a90a0a03b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-450332166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3044bca7-ffa7-4883-8b97-f634c3fbd9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c58788ae13444bbb32c8845cfb6852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2bfd16a6-3a77-4746-8954-5017e4b127dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:11Z,use_quota=True,user_id='b81fad8c88e74a08b27030aece4e0df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fa4036-92ee-431f-b263-5c254fd7eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fa4036-92ee-431f-b263-5c254fd7eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c6b9b7-2d7a-42ae-aa7e-3f7973e53409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c6b9b7-2d7a-42ae-aa7e-3f7973e53409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3044bca7-ffa7-4883-8b97-f634c3fbd9b9', 'volume_name': 'volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9', 'volume_size': 1, 'snapshot_id': '2bfd16a6-3a77-4746-8954-5017e4b127dc'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98dae89-4e94-4764-be4e-a9bd0c7cf753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98dae89-4e94-4764-be4e-a9bd0c7cf753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab208d33-e76c-4b13-ba4b-6531dd08a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:11 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Volume 3044bca7-ffa7-4883-8b97-f634c3fbd9b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9', 'volume_size': 1, 'snapshot_id': '2bfd16a6-3a77-4746-8954-5017e4b127dc'} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-2bfd16a6-3a77-4746-8954-5017e4b127dc-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-2bfd16a6-3a77-4746-8954-5017e4b127dc-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Creating volume 3044bca7-ffa7-4883-8b97-f634c3fbd9b9 from snapshot 2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] snapshot: 2bfd16a6-3a77-4746-8954-5017e4b127dc, volume: 3044bca7-ffa7-4883-8b97-f634c3fbd9b9, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0cf521-483a-42ac-9ae6-1039e87f0acc]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:11 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc Sep 28 18:10:11 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:12 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc" returned: 0 in 0.611s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d3bd3-1c31-4318-bafa-2fa1d04ba3bc]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:12 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 Sep 28 18:10:12 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:12 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" returned: 0 in 0.510s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:10:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:12 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 Sep 28 18:10:12 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:21 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=44,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:21 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=53,cinder:SELECT=37,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:21 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" returned: 0 in 9.218s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:21 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:10:21 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Converted 1024.00 MB image at 111.07 MB/s Sep 28 18:10:21 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 is being set with open permissions: ugo+rw Sep 28 18:10:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:21 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 Sep 28 18:10:21 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:22 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" returned: 0 in 0.397s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" released by "_copy_volume_from_snapshot" :: held 10.879s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-2bfd16a6-3a77-4746-8954-5017e4b127dc-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" released by "_create_volume_from_snapshot" :: held 10.979s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.997s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab208d33-e76c-4b13-ba4b-6531dd08a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9', 'volume_size': 1, 'snapshot_id': '2bfd16a6-3a77-4746-8954-5017e4b127dc'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81004fc5-cb2a-49b3-b424-1b8339a14fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:22 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Volume volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 (3044bca7-ffa7-4883-8b97-f634c3fbd9b9): created successfully Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81004fc5-cb2a-49b3-b424-1b8339a14fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Flow 'volume_create_manager' (5e1f84b6-a251-45a7-a4a1-b82feec57c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:22 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7e535293-eaa6-48a7-94c8-75866a30b3ef tempest-VolumesDeleteCascade-1275648662 None] Created volume successfully. Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Performing cascade delete. {{(pid=87096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-2bfd16a6-3a77-4746-8954-5017e4b127dc-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-2bfd16a6-3a77-4746-8954-5017e4b127dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-2bfd16a6-3a77-4746-8954-5017e4b127dc" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-2bfd16a6-3a77-4746-8954-5017e4b127dc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Deleting offline snapshot 2bfd16a6-3a77-4746-8954-5017e4b127dc of volume db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:10:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] snapshot_file for this snap is: volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e32a091-4de7-4bf5-84fd-3331e9e0baf7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:23 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc Sep 28 18:10:23 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:23 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf90e13-3e58-4c4c-861f-caed807e5f55]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:23 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 Sep 28 18:10:23 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:23 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:10:23 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:24 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.448s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:10:24 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" returned: 0 in 0.726s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:24 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc Sep 28 18:10:24 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:24 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc" returned: 0 in 0.562s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:24 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc Sep 28 18:10:24 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:25 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4.2bfd16a6-3a77-4746-8954-5017e4b127dc" returned: 0 in 0.525s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-2bfd16a6-3a77-4746-8954-5017e4b127dc" released by "_delete_snapshot" :: held 2.377s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" released by "delete_snapshot" :: held 2.414s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Created reservations ['78d92ee4-9d42-490d-965a-58424e228300', '3f5da5b4-a93d-4c39-8e1e-c37a1b6a3343', '2c8f5389-dbc5-47a1-ad41-f4b5e44ab135', '38ec5274-b2fd-4a0b-ae5a-e4c3d231d891'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:25 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Delete snapshot completed successfully. Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-2bfd16a6-3a77-4746-8954-5017e4b127dc-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Snapshots deleted, issuing volume delete {{(pid=87096) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c072ec7-b897-4c83-b776-7b6112de0ac7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:25 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 Sep 28 18:10:25 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:26 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:26 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4 Sep 28 18:10:26 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:26 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" returned: 0 in 0.335s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4" released by "delete_volume" :: held 0.903s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Created reservations ['8dba0959-47f0-480d-b9b0-41e21b62a44c', '55ca6755-71d4-4ab5-a72a-eff439444a6b', '2c1686eb-6ee5-43cc-8acc-6262c37bb99f', '13f88e32-0637-45c8-8e44-b9dfc73f1d1e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:26 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:10:26 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:26 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.346s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:26 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:27 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Deleted volume successfully. Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9990f986-a9a5-431d-b037-0d3964e15d4e tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-db916089-ff1f-4bb6-b0f7-80d7ba88c3a4-delete_volume" released by "delete_volume" :: held 4.236s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-3044bca7-ffa7-4883-8b97-f634c3fbd9b9-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-3044bca7-ffa7-4883-8b97-f634c3fbd9b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "cinder-quobyte-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b36c1c1-4540-4589-ab67-71a71352a3d0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-b7a0a332-b7d7-4c09-8c3e-be69c682bfb1 req-c9632e13-8ea5-4763-bb10-020e39235139 tempest-AttachVolumeShelveTestJSON-753631210 None] No connector for attachment ee4dc51a-b1db-4459-8bed-290b8c925cd5; skipping storage backend terminate_connection call. {{(pid=87096) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 18:10:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-b7a0a332-b7d7-4c09-8c3e-be69c682bfb1 req-c9632e13-8ea5-4763-bb10-020e39235139 tempest-AttachVolumeShelveTestJSON-753631210 None] Deleting attachment ee4dc51a-b1db-4459-8bed-290b8c925cd5. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:10:27 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 Sep 28 18:10:27 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:28 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" returned: 0 in 0.625s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:28 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9 Sep 28 18:10:28 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:28 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" returned: 0 in 0.493s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-quobyte-3044bca7-ffa7-4883-8b97-f634c3fbd9b9" released by "delete_volume" :: held 1.229s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Created reservations ['69f0075b-47c3-4aa6-bfd6-ccdd53e2e056', 'b9552f43-29c3-4d45-8ef0-11a1e01683ae', 'a8de065f-89b6-46f0-8986-6f6cde9c0622', '106fdf53-9f05-420a-b003-2ab61ddf66b1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:29 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:10:29 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:29 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.363s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Deleted volume successfully. Sep 28 18:10:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e8f41f3e-8180-4d37-a86a-e003a0094bb6 tempest-VolumesDeleteCascade-1275648662 None] Lock "cinder-3044bca7-ffa7-4883-8b97-f634c3fbd9b9-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Flow 'volume_create_manager' (bffac0ef-98b0-4124-a7fb-9148926c30a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4880e75-d515-4611-8720-17b19ca37bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4880e75-d515-4611-8720-17b19ca37bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-21839316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dd1b71-c75c-4804-b3cc-54d991bd2788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6d2a6fe3042b2acfd4f3bbcc7ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:36Z,use_quota=True,user_id='ccb52f6752f94636a78afe55e962a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(712cff46-857b-4f26-a284-bc4a3a6c3c4b),volume_type_id=712cff46-857b-4f26-a284-bc4a3a6c3c4b)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c78d81e-a074-473b-b65d-3df32e0645d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c78d81e-a074-473b-b65d-3df32e0645d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a254076-2384-4c95-8ad2-abcd74b12c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a254076-2384-4c95-8ad2-abcd74b12c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55dd1b71-c75c-4804-b3cc-54d991bd2788', 'volume_name': 'volume-55dd1b71-c75c-4804-b3cc-54d991bd2788', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d7cc45-57ed-44b0-99cd-50cef0c85457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d7cc45-57ed-44b0-99cd-50cef0c85457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c77f694-6b52-421a-8b30-9f47f7264e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Volume 55dd1b71-c75c-4804-b3cc-54d991bd2788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55dd1b71-c75c-4804-b3cc-54d991bd2788', 'volume_size': 1} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-21839316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55dd1b71-c75c-4804-b3cc-54d991bd2788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6d2a6fe3042b2acfd4f3bbcc7ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:36Z,use_quota=True,user_id='ccb52f6752f94636a78afe55e962a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(712cff46-857b-4f26-a284-bc4a3a6c3c4b),volume_type_id=712cff46-857b-4f26-a284-bc4a3a6c3c4b)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Creating volume 55dd1b71-c75c-4804-b3cc-54d991bd2788 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:36 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:36 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 1073741824 Sep 28 18:10:36 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Flow 'volume_create_manager' (c63205a7-3e8b-4b05-85d6-3a7c0c942de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e250fd9e-2b77-4890-8886-d273670f7ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e250fd9e-2b77-4890-8886-d273670f7ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2013661210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d916bc9-660a-477b-9b06-4d272d9393f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6d2a6fe3042b2acfd4f3bbcc7ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:37Z,use_quota=True,user_id='ccb52f6752f94636a78afe55e962a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdba81d4-d1c2-4431-87d2-ecf1bb167249),volume_type_id=fdba81d4-d1c2-4431-87d2-ecf1bb167249)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915bd789-35b0-4370-b385-9b46b828fa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915bd789-35b0-4370-b385-9b46b828fa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e264b0e-c5d2-4c91-adba-cfa098b56ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e264b0e-c5d2-4c91-adba-cfa098b56ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d916bc9-660a-477b-9b06-4d272d9393f0', 'volume_name': 'volume-6d916bc9-660a-477b-9b06-4d272d9393f0', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d3ce1-2f29-42f2-baca-cd7e907d056f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d3ce1-2f29-42f2-baca-cd7e907d056f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03b9752-17dc-4b77-97f4-1ab06bac015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Volume 6d916bc9-660a-477b-9b06-4d272d9393f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d916bc9-660a-477b-9b06-4d272d9393f0', 'volume_size': 1} Sep 28 18:10:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:37 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 1073741824" returned: 0 in 0.872s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:37 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 Sep 28 18:10:37 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:37 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788" returned: 0 in 0.468s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2013661210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d916bc9-660a-477b-9b06-4d272d9393f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6d2a6fe3042b2acfd4f3bbcc7ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:37Z,use_quota=True,user_id='ccb52f6752f94636a78afe55e962a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fdba81d4-d1c2-4431-87d2-ecf1bb167249),volume_type_id=fdba81d4-d1c2-4431-87d2-ecf1bb167249)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Creating volume 6d916bc9-660a-477b-9b06-4d272d9393f0 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c77f694-6b52-421a-8b30-9f47f7264e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55dd1b71-c75c-4804-b3cc-54d991bd2788', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf0e01b-df97-4de0-ab07-25cc73ee4101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:37 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 1073741824 Sep 28 18:10:37 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Volume volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 (55dd1b71-c75c-4804-b3cc-54d991bd2788): created successfully Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf0e01b-df97-4de0-ab07-25cc73ee4101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Flow 'volume_create_manager' (bffac0ef-98b0-4124-a7fb-9148926c30a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-24eaaaf9-fbea-49a8-9689-6c6ffcdfa284 tempest-TestInstancesWithCinderVolumes-773018043 None] Created volume successfully. Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Flow 'volume_create_manager' (d2e4cd2b-37c9-4619-9673-d2c2193a8a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e90ca29-e0af-4a04-88ff-6f845b298493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e90ca29-e0af-4a04-88ff-6f845b298493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1822974577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b78a201-939d-40c1-aecc-63586cba5dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6d2a6fe3042b2acfd4f3bbcc7ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:38Z,use_quota=True,user_id='ccb52f6752f94636a78afe55e962a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac3ff7db-f6e7-4880-a825-3260a4e5f287),volume_type_id=ac3ff7db-f6e7-4880-a825-3260a4e5f287)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ae5728-f4b1-4fb3-9391-a6ce7eb37924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ae5728-f4b1-4fb3-9391-a6ce7eb37924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1e047c-869b-4e26-99bb-de7cb2bf7fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:10:38 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 1073741824" returned: 0 in 0.681s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:38 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 Sep 28 18:10:38 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1e047c-869b-4e26-99bb-de7cb2bf7fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b78a201-939d-40c1-aecc-63586cba5dce', 'volume_name': 'volume-7b78a201-939d-40c1-aecc-63586cba5dce', 'volume_size': 1, 'image_id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2041044301', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75a6d2a6fe3042b2acfd4f3bbcc7ede1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'created_at': datetime.datetime(2026, 9, 28, 16, 10, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 10, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5/file', 'properties': {}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ef03e8-b9f0-4aa7-91aa-949ef9aafaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ef03e8-b9f0-4aa7-91aa-949ef9aafaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c37e40-0bb0-46d7-b903-60db3c87ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:38 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Volume 7b78a201-939d-40c1-aecc-63586cba5dce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b78a201-939d-40c1-aecc-63586cba5dce', 'volume_size': 1, 'image_id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2041044301', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75a6d2a6fe3042b2acfd4f3bbcc7ede1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'created_at': datetime.datetime(2026, 9, 28, 16, 10, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 10, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5/file', 'properties': {}}, 'image_service': } Sep 28 18:10:38 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Trying to clone 7b78a201-939d-40c1-aecc-63586cba5dce from image df02ae13-a5ea-42df-bff8-ef0d42f70af5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:10:39 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0" returned: 0 in 0.493s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03b9752-17dc-4b77-97f4-1ab06bac015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d916bc9-660a-477b-9b06-4d272d9393f0', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434c0a32-d364-4756-806d-c17cfe9cb7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Volume volume-6d916bc9-660a-477b-9b06-4d272d9393f0 (6d916bc9-660a-477b-9b06-4d272d9393f0): created successfully Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434c0a32-d364-4756-806d-c17cfe9cb7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Flow 'volume_create_manager' (c63205a7-3e8b-4b05-85d6-3a7c0c942de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-413a42cc-435d-4a08-89f4-22f8fbc9da9a tempest-TestInstancesWithCinderVolumes-773018043 None] Created volume successfully. Sep 28 18:10:43 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD, size 20.69 MB, duration 4.67 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:10:43 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Image download 20.69 MB at 4.43 MB/s Sep 28 18:10:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d45f7f6-1f9f-4f28-a621-6570f0dffe27]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:43 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD Sep 28 18:10:43 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:44 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Temporary image df02ae13-a5ea-42df-bff8-ef0d42f70af5 is fetched for user ccb52f6752f94636a78afe55e962a94e. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c4c4ff-c627-44e6-b5c8-e7f938d2eef9]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:44 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD Sep 28 18:10:44 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:44 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1822974577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b78a201-939d-40c1-aecc-63586cba5dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75a6d2a6fe3042b2acfd4f3bbcc7ede1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:38Z,use_quota=True,user_id='ccb52f6752f94636a78afe55e962a94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac3ff7db-f6e7-4880-a825-3260a4e5f287),volume_type_id=ac3ff7db-f6e7-4880-a825-3260a4e5f287)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Creating volume 7b78a201-939d-40c1-aecc-63586cba5dce {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:44 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:10:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:44 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce 1073741824 Sep 28 18:10:44 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:45 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce 1073741824" returned: 0 in 0.783s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:45 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce Sep 28 18:10:45 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:46 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Attempting download of df02ae13-a5ea-42df-bff8-ef0d42f70af5 ((None, [{'url': 'file:///opt/stack/data/glance/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'metadata': {}}])) to volume 7b78a201-939d-40c1-aecc-63586cba5dce. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b87979-ffab-4c26-8c4e-d069b0e7733f]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:46 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu Sep 28 18:10:46 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:46 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu" returned: 0 in 0.535s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:47 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu Sep 28 18:10:47 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:47 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu" returned: 1 in 0.489s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_df02ae13-a5ea-42df-bff8-ef0d42f70af5_mwr8jxxu' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3438a16b-b35b-4414-88fa-c0db4b75dfc0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:47 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD Sep 28 18:10:47 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:47 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] df02ae13-a5ea-42df-bff8-ef0d42f70af5 was qcow2, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:10:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:47 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce Sep 28 18:10:47 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce" returned: 0 in 2.632s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_df02ae13-a5ea-42df-bff8-ef0d42f70af5_4m6u_fyldevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:10:50 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Converted 112.00 MB image at 42.53 MB/s Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:50 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce 1G Sep 28 18:10:50 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:50 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce 1G" returned: 0 in 0.494s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Downloaded image df02ae13-a5ea-42df-bff8-ef0d42f70af5 ((None, [{'url': 'file:///opt/stack/data/glance/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'metadata': {}}])) to volume 7b78a201-939d-40c1-aecc-63586cba5dce successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Temporary image df02ae13-a5ea-42df-bff8-ef0d42f70af5 for user ccb52f6752f94636a78afe55e962a94e is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Marking volume 7b78a201-939d-40c1-aecc-63586cba5dce as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Copying metadata from image df02ae13-a5ea-42df-bff8-ef0d42f70af5 to 7b78a201-939d-40c1-aecc-63586cba5dce. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:10:50 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Creating volume glance metadata for volume 7b78a201-939d-40c1-aecc-63586cba5dce backed by image df02ae13-a5ea-42df-bff8-ef0d42f70af5 with: {'image_id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'image_name': 'tempest-scenario-img--2041044301', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:10:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c37e40-0bb0-46d7-b903-60db3c87ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b78a201-939d-40c1-aecc-63586cba5dce', 'volume_size': 1, 'image_id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2041044301', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75a6d2a6fe3042b2acfd4f3bbcc7ede1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'df02ae13-a5ea-42df-bff8-ef0d42f70af5', 'created_at': datetime.datetime(2026, 9, 28, 16, 10, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 10, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/df02ae13-a5ea-42df-bff8-ef0d42f70af5/file', 'properties': {}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c232c41d-a2e7-439d-ad7c-b0ff1536ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Volume volume-7b78a201-939d-40c1-aecc-63586cba5dce (7b78a201-939d-40c1-aecc-63586cba5dce): created successfully Sep 28 18:10:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c232c41d-a2e7-439d-ad7c-b0ff1536ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Flow 'volume_create_manager' (d2e4cd2b-37c9-4619-9673-d2c2193a8a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4403766c-d711-47a7-a154-d06bb3a658aa tempest-TestInstancesWithCinderVolumes-773018043 None] Created volume successfully. Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Flow 'volume_create_manager' (43149f97-75ed-4323-9ea0-a7a9543cadd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf8e1da-a391-43e2-ad77-bb2c3eb3f8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf8e1da-a391-43e2-ad77-bb2c3eb3f8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1467366431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a6653c-a75e-4de3-9ee7-dbbe2f922472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afdeec2a52a4279bed5b71a00362f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:53Z,use_quota=True,user_id='13caf2df226941308f07fe3a140c29a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203baab5-06ef-42f4-9b37-165d96e80ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203baab5-06ef-42f4-9b37-165d96e80ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76da48ad-8085-404f-851b-a0a82e216baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76da48ad-8085-404f-851b-a0a82e216baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a6653c-a75e-4de3-9ee7-dbbe2f922472', 'volume_name': 'volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab7a54f-b6dc-4d5a-8409-c4c51c0a2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab7a54f-b6dc-4d5a-8409-c4c51c0a2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4777fe47-d06f-4bc6-a3da-b79be85eb895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Volume 02a6653c-a75e-4de3-9ee7-dbbe2f922472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472', 'volume_size': 1} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1467366431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a6653c-a75e-4de3-9ee7-dbbe2f922472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afdeec2a52a4279bed5b71a00362f32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:53Z,use_quota=True,user_id='13caf2df226941308f07fe3a140c29a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Creating volume 02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:53 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 1073741824 Sep 28 18:10:53 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 1073741824" returned: 0 in 0.596s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:10:53 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.458s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4777fe47-d06f-4bc6-a3da-b79be85eb895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02683ed-a982-4ccf-9768-96776eb8a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Volume volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 (02a6653c-a75e-4de3-9ee7-dbbe2f922472): created successfully Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02683ed-a982-4ccf-9768-96776eb8a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Flow 'volume_create_manager' (43149f97-75ed-4323-9ea0-a7a9543cadd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-425c9d79-f6a0-42b3-bc9b-b1d4deff8137 tempest-VolumesActionsTest-1167058101 None] Created volume successfully. Sep 28 18:10:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-40933523-eda2-4fce-a4fd-1e04e6c8f8f1 req-3d09d900-fdde-4c0c-9d62-d352fdb5056d tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-40933523-eda2-4fce-a4fd-1e04e6c8f8f1 req-3d09d900-fdde-4c0c-9d62-d352fdb5056d tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-40933523-eda2-4fce-a4fd-1e04e6c8f8f1 req-3d09d900-fdde-4c0c-9d62-d352fdb5056d tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:56 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-40933523-eda2-4fce-a4fd-1e04e6c8f8f1 req-3d09d900-fdde-4c0c-9d62-d352fdb5056d tempest-TestInstancesWithCinderVolumes-773018043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-7b78a201-939d-40c1-aecc-63586cba5dce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b7e04dc-0636-4865-b721-cdd433470032', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:10:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-40933523-eda2-4fce-a4fd-1e04e6c8f8f1 req-3d09d900-fdde-4c0c-9d62-d352fdb5056d tempest-TestInstancesWithCinderVolumes-773018043 None] attachment_update completed successfully. Sep 28 18:11:06 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=39,cinder:UPDATE=42,cinder:DELETE=5,cinder:INSERT=12 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:06 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=36,cinder:INSERT=14,cinder:SELECT=37,cinder:DELETE=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95c582bc-b5a9-480b-9dca-249f58cba2f4 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472" by "attach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95c582bc-b5a9-480b-9dca-249f58cba2f4 tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472" acquired by "attach_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-95c582bc-b5a9-480b-9dca-249f58cba2f4 tempest-VolumesActionsTest-1167058101 None] Attaching volume 02a6653c-a75e-4de3-9ee7-dbbe2f922472 to instance 003ff101-0769-44f2-a3d2-b81a069e7ee1 at mountpoint /dev/vdb on host None. Sep 28 18:11:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-95c582bc-b5a9-480b-9dca-249f58cba2f4 tempest-VolumesActionsTest-1167058101 None] Attach volume completed successfully. Sep 28 18:11:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95c582bc-b5a9-480b-9dca-249f58cba2f4 tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472" released by "attach_volume" :: held 0.184s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-32b90386-10ed-43e1-822c-77a4ebdb26de tempest-VolumesActionsTest-1167058101 None] Acquiring lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-detach_volume" by "detach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-32b90386-10ed-43e1-822c-77a4ebdb26de tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-32b90386-10ed-43e1-822c-77a4ebdb26de tempest-VolumesActionsTest-1167058101 None] Detaching volume 02a6653c-a75e-4de3-9ee7-dbbe2f922472 from instance 003ff101-0769-44f2-a3d2-b81a069e7ee1. Sep 28 18:11:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-32b90386-10ed-43e1-822c-77a4ebdb26de tempest-VolumesActionsTest-1167058101 None] Detach volume completed successfully. Sep 28 18:11:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-32b90386-10ed-43e1-822c-77a4ebdb26de tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-detach_volume" released by "detach_volume" :: held 0.265s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Acquiring lock "cinder-27505c41-cb09-4bad-ae11-22defef7db31-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "cinder-27505c41-cb09-4bad-ae11-22defef7db31-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Acquiring lock "cinder-quobyte-27505c41-cb09-4bad-ae11-22defef7db31" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "cinder-quobyte-27505c41-cb09-4bad-ae11-22defef7db31" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa7027-3fc5-4353-bfd4-d2c32550ab51]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:17 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 Sep 28 18:11:17 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:18 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31" returned: 0 in 0.790s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:18 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31 Sep 28 18:11:18 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:18 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-27505c41-cb09-4bad-ae11-22defef7db31" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "cinder-quobyte-27505c41-cb09-4bad-ae11-22defef7db31" released by "delete_volume" :: held 1.282s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Created reservations ['0bf049b3-0886-47f4-b750-fa3d3ee8bc6e', 'd5f51a75-6566-4919-a37c-e6cd91c32980', '190fca1f-9798-4a6c-a245-391e5ef1bac5', 'dbdc05e1-41dc-46ff-9814-67db4c7b2a41'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:19 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:11:19 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:19 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.559s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:19 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Deleted volume successfully. Sep 28 18:11:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4461612d-23df-4319-a336-ba0406cd960d tempest-AttachVolumeShelveTestJSON-753631210 None] Lock "cinder-27505c41-cb09-4bad-ae11-22defef7db31-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:23 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:11:23 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:24 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.555s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:11:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:11:28 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:29 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2e9c4b4b-a3c1-4052-832d-5a3741d460f9 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472" by "attach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2e9c4b4b-a3c1-4052-832d-5a3741d460f9 tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472" acquired by "attach_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:30 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2e9c4b4b-a3c1-4052-832d-5a3741d460f9 tempest-VolumesActionsTest-1167058101 None] Attaching volume 02a6653c-a75e-4de3-9ee7-dbbe2f922472 to instance 6462a414-01a2-4862-b88f-c6125d0505a5 at mountpoint /dev/vdb on host None. Sep 28 18:11:30 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2e9c4b4b-a3c1-4052-832d-5a3741d460f9 tempest-VolumesActionsTest-1167058101 None] Attach volume completed successfully. Sep 28 18:11:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2e9c4b4b-a3c1-4052-832d-5a3741d460f9 tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472" released by "attach_volume" :: held 0.134s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4ddc71ac-8843-438e-a1a9-002aaf7ff0e5 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-detach_volume" by "detach_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4ddc71ac-8843-438e-a1a9-002aaf7ff0e5 tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:31 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4ddc71ac-8843-438e-a1a9-002aaf7ff0e5 tempest-VolumesActionsTest-1167058101 None] Detaching volume 02a6653c-a75e-4de3-9ee7-dbbe2f922472 from instance 6462a414-01a2-4862-b88f-c6125d0505a5. Sep 28 18:11:31 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4ddc71ac-8843-438e-a1a9-002aaf7ff0e5 tempest-VolumesActionsTest-1167058101 None] Detach volume completed successfully. Sep 28 18:11:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4ddc71ac-8843-438e-a1a9-002aaf7ff0e5 tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134b758-1ddd-44cb-aaa1-3cb4fb6381a8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:37 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:11:37 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:38 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.419s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[26066bea-b387-4d58-aa2c-92c578cdc6bd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:38 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:11:38 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:38 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.455s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.435b5870-929a-468d-884e-b7e4631e76c55hw30am2.img {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:38 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.435b5870-929a-468d-884e-b7e4631e76c55hw30am2.img Sep 28 18:11:38 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:41 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-375a9ec6-bc33-4d66-8d51-2062fb76aa9c req-14b267e3-f8f1-41e8-983e-e1ebb111250f tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:46 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.435b5870-929a-468d-884e-b7e4631e76c55hw30am2.img" returned: 0 in 8.198s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[592d9a20-c852-469f-a958-0e6cff149685]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:47 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:11:47 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:47 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.631s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:47 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.435b5870-929a-468d-884e-b7e4631e76c55hw30am2.img {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:11:47 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Converted 1024.00 MB image at 124.89 MB/s Sep 28 18:11:47 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] 435b5870-929a-468d-884e-b7e4631e76c5 was raw, no need to convert to raw {{(pid=87096) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:11:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-63d350a6-f03a-4603-be26-f081f762c903 tempest-GroupsTest-1816309909 None] Group tempest-Group1-101136508: creating Sep 28 18:11:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-63d350a6-f03a-4603-be26-f081f762c903 tempest-GroupsTest-1816309909 None] Group tempest-Group1-101136508: created successfully Sep 28 18:11:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-63d350a6-f03a-4603-be26-f081f762c903 tempest-GroupsTest-1816309909 None] Create group completed successfully. Sep 28 18:11:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-50802c11-3950-4265-9152-232ef9bd7017 tempest-GroupsTest-1816309909 None] Group tempest-Group2-965529226: creating Sep 28 18:11:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-50802c11-3950-4265-9152-232ef9bd7017 tempest-GroupsTest-1816309909 None] Group tempest-Group2-965529226: created successfully Sep 28 18:11:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-50802c11-3950-4265-9152-232ef9bd7017 tempest-GroupsTest-1816309909 None] Create group completed successfully. Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Flow 'volume_create_manager' (7a5c4b34-903b-4e5c-ab69-6a4fe9d0c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72efd9f6-6992-4b50-8fca-57d0b52931c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72efd9f6-6992-4b50-8fca-57d0b52931c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2782166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4c33926-730f-4ffb-9560-b11050f568c8,host='devstack@QuobyteHD#QuobyteHD',id=1a032264-2ece-4f94-a9d1-695f61345a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50412ab49e6e4d7083f89484d198389e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:54Z,use_quota=True,user_id='cb5eee85a215445eb93ae05f830df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86160692-a66b-4b86-9682-c89f08ddc64a),volume_type_id=86160692-a66b-4b86-9682-c89f08ddc64a)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25a55dc-0989-428b-9380-ee4c031ce8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25a55dc-0989-428b-9380-ee4c031ce8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e52b53-d4f2-452d-8839-e9043b77f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e52b53-d4f2-452d-8839-e9043b77f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a032264-2ece-4f94-a9d1-695f61345a81', 'volume_name': 'volume-1a032264-2ece-4f94-a9d1-695f61345a81', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa86efc8-0e9a-4409-aff7-422e2aa586dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa86efc8-0e9a-4409-aff7-422e2aa586dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a8a95e-1719-4795-9c27-abc70d08500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Volume 1a032264-2ece-4f94-a9d1-695f61345a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a032264-2ece-4f94-a9d1-695f61345a81', 'volume_size': 1} Sep 28 18:11:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.026s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Uploaded volume to glance image-id: 435b5870-929a-468d-884e-b7e4631e76c5. {{(pid=87096) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-375a9ec6-bc33-4d66-8d51-2062fb76aa9c req-14b267e3-f8f1-41e8-983e-e1ebb111250f tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.228s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-375a9ec6-bc33-4d66-8d51-2062fb76aa9c req-14b267e3-f8f1-41e8-983e-e1ebb111250f tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.499s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b4c33926-730f-4ffb-9560-b11050f568c8,created_at=2026-09-28T16:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2782166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4c33926-730f-4ffb-9560-b11050f568c8,host='devstack@QuobyteHD#QuobyteHD',id=1a032264-2ece-4f94-a9d1-695f61345a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50412ab49e6e4d7083f89484d198389e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:54Z,use_quota=True,user_id='cb5eee85a215445eb93ae05f830df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86160692-a66b-4b86-9682-c89f08ddc64a),volume_type_id=86160692-a66b-4b86-9682-c89f08ddc64a)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Creating volume 1a032264-2ece-4f94-a9d1-695f61345a81 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:08 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-55d55a52-4dfa-4c8f-815b-bbf345056e03 tempest-VolumesActionsTest-1167058101 None] Copy volume to image completed successfully. Sep 28 18:12:08 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 1073741824 Sep 28 18:12:08 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-375a9ec6-bc33-4d66-8d51-2062fb76aa9c req-14b267e3-f8f1-41e8-983e-e1ebb111250f tempest-TestInstancesWithCinderVolumes-773018043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-55dd1b71-c75c-4804-b3cc-54d991bd2788', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c41fc2e0-378d-4493-ba04-7a15e93c2c1b', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:12:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-375a9ec6-bc33-4d66-8d51-2062fb76aa9c req-14b267e3-f8f1-41e8-983e-e1ebb111250f tempest-TestInstancesWithCinderVolumes-773018043 None] attachment_update completed successfully. Sep 28 18:12:09 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 1073741824" returned: 0 in 0.637s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:09 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 Sep 28 18:12:09 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:09 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81" returned: 0 in 0.398s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a8a95e-1719-4795-9c27-abc70d08500b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a032264-2ece-4f94-a9d1-695f61345a81', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8696a73-e969-43b6-97bd-5d70b5f6dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:10 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Volume volume-1a032264-2ece-4f94-a9d1-695f61345a81 (1a032264-2ece-4f94-a9d1-695f61345a81): created successfully Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8696a73-e969-43b6-97bd-5d70b5f6dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Flow 'volume_create_manager' (7a5c4b34-903b-4e5c-ab69-6a4fe9d0c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ab3304f1-9747-4451-a31e-549da05b6fe1 tempest-GroupsTest-1816309909 None] Created volume successfully. Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18ff91-5a5b-4439-9c25-fd0977a433b8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:10 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:12:10 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:11 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.506s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d572981-1836-49b9-ae89-c8016f4ff17c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:11 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:12:11 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:11 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.570s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:11 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img Sep 28 18:12:11 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-82ef96a4-698a-4b7b-94b7-382209adc32d req-03a614ac-5a28-47f4-925c-ca1484d48efe tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Acquiring lock "cinder-quobyte-1a032264-2ece-4f94-a9d1-695f61345a81" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Lock "cinder-quobyte-1a032264-2ece-4f94-a9d1-695f61345a81" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cbcc91-f590-498a-afaa-7fbb76720af3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:12 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 Sep 28 18:12:12 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81" returned: 0 in 0.847s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:13 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81 Sep 28 18:12:13 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a032264-2ece-4f94-a9d1-695f61345a81" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Lock "cinder-quobyte-1a032264-2ece-4f94-a9d1-695f61345a81" released by "delete_volume" :: held 1.326s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:13 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Created reservations ['eacd5e11-13fe-4b2a-842e-bad0be43b70c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:13 devstack cinder-volume[87096]: WARNING cinder.quota [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1370599697 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1370599697, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:13 devstack cinder-volume[87096]: WARNING cinder.quota [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1370599697 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1370599697, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:13 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Created reservations ['876064e5-47a5-43e8-b296-61ddb2600199', 'be2093f2-e877-4ae4-a05c-d86dbe4ee79a', '7e669ef6-c852-4173-a79b-538b22c88ef4', '9084fadd-4ade-4f2f-a8ce-b70b6f675134'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:14 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:14 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:14 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.406s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:14 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-548a30c7-404f-4e58-bab1-a27c8bee1868 tempest-GroupsTest-1816309909 None] Delete group completed successfully. Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Created reservations ['3d73fdfc-042e-476d-88da-bb401a7aedd0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:15 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.592s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:16 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-abf3166e-a991-4bcd-8cd0-64382af11ea3 tempest-GroupsTest-1816309909 None] Delete group completed successfully. Sep 28 18:12:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-edafe592-79e8-4607-a338-2fce517b19d5 tempest-GroupsTest-1816309909 None] Group tempest-GroupsTest-Group-35825412: creating Sep 28 18:12:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-edafe592-79e8-4607-a338-2fce517b19d5 tempest-GroupsTest-1816309909 None] Group tempest-GroupsTest-Group-35825412: created successfully Sep 28 18:12:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-edafe592-79e8-4607-a338-2fce517b19d5 tempest-GroupsTest-1816309909 None] Create group completed successfully. Sep 28 18:12:19 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img" returned: 0 in 7.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c25326-b587-429b-ae51-dfdb875fa901]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:19 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:12:19 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Flow 'volume_create_manager' (c366070a-5622-406e-b4c7-6090abff6f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ce0182-d1eb-4764-98d8-d1214d19a49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ce0182-d1eb-4764-98d8-d1214d19a49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-163176232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2211516b-d8d8-447a-a9be-dc283c68c3a0,host='devstack@QuobyteHD#QuobyteHD',id=b5f5c518-06dd-407c-9fb5-7620d52c5f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50412ab49e6e4d7083f89484d198389e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:20Z,use_quota=True,user_id='cb5eee85a215445eb93ae05f830df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b68b886-4b58-496c-a20e-8136fed0b6ac),volume_type_id=4b68b886-4b58-496c-a20e-8136fed0b6ac)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37da1dd7-b2f8-4570-93b1-993e555b2770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37da1dd7-b2f8-4570-93b1-993e555b2770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc2cd60-b4d4-4066-9833-b9fcbe97b1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc2cd60-b4d4-4066-9833-b9fcbe97b1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f5c518-06dd-407c-9fb5-7620d52c5f6d', 'volume_name': 'volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c0aa5e-4244-4e82-b6e9-6cc853224113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c0aa5e-4244-4e82-b6e9-6cc853224113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa32194-65fd-45d8-a388-27c27b14ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Volume b5f5c518-06dd-407c-9fb5-7620d52c5f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d', 'volume_size': 1} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:20 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.760s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:20 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Converted 1024.00 MB image at 137.74 MB/s Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] 85c02833-5f61-4692-a3db-feec741b4d9f was raw, converting to qcow2 {{(pid=87096) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc601e-94a5-4b75-99df-ea2b13fda7fc]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img Sep 28 18:12:20 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:20 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img" returned: 0 in 0.445s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img Sep 28 18:12:20 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:20 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img" returned: 1 in 0.370s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:12:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b Sep 28 18:12:21 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:21 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b" returned: 0 in 0.328s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:21 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Image conversion details: src /opt/stack/data/cinder/conversion/02a6653c-a75e-4de3-9ee7-dbbe2f922472.temp_image.85c02833-5f61-4692-a3db-feec741b4d9f6z630nul.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:21 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 18:12:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb54a832-91ae-4a1e-b975-38bf96e361f8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b Sep 28 18:12:21 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:21 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lk9asl2b" returned: 0 in 0.451s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.401s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Uploaded volume to glance image-id: 85c02833-5f61-4692-a3db-feec741b4d9f. {{(pid=87096) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-82ef96a4-698a-4b7b-94b7-382209adc32d req-03a614ac-5a28-47f4-925c-ca1484d48efe tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.161s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-82ef96a4-698a-4b7b-94b7-382209adc32d req-03a614ac-5a28-47f4-925c-ca1484d48efe tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.191s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2211516b-d8d8-447a-a9be-dc283c68c3a0,created_at=2026-09-28T16:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-163176232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2211516b-d8d8-447a-a9be-dc283c68c3a0,host='devstack@QuobyteHD#QuobyteHD',id=b5f5c518-06dd-407c-9fb5-7620d52c5f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50412ab49e6e4d7083f89484d198389e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:20Z,use_quota=True,user_id='cb5eee85a215445eb93ae05f830df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b68b886-4b58-496c-a20e-8136fed0b6ac),volume_type_id=4b68b886-4b58-496c-a20e-8136fed0b6ac)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Creating volume b5f5c518-06dd-407c-9fb5-7620d52c5f6d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:23 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a152c390-f914-45da-a176-ab27c9d1ce98 tempest-VolumesActionsTest-1167058101 None] Copy volume to image completed successfully. Sep 28 18:12:23 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d 1073741824 Sep 28 18:12:23 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-82ef96a4-698a-4b7b-94b7-382209adc32d req-03a614ac-5a28-47f4-925c-ca1484d48efe tempest-TestInstancesWithCinderVolumes-773018043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-6d916bc9-660a-477b-9b06-4d272d9393f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a2519b0-293d-4e6f-8d6f-1c0a6754410b', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:12:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-82ef96a4-698a-4b7b-94b7-382209adc32d req-03a614ac-5a28-47f4-925c-ca1484d48efe tempest-TestInstancesWithCinderVolumes-773018043 None] attachment_update completed successfully. Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:23 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:23 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:23 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d 1073741824" returned: 0 in 0.585s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:23 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d Sep 28 18:12:23 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:24 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.426s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:12:24 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa32194-65fd-45d8-a388-27c27b14ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69f0d26-f776-4cb0-9ca9-3d9c92cae0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:24 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Volume volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d (b5f5c518-06dd-407c-9fb5-7620d52c5f6d): created successfully Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69f0d26-f776-4cb0-9ca9-3d9c92cae0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Flow 'volume_create_manager' (c366070a-5622-406e-b4c7-6090abff6f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-91a648b3-eddd-4594-beb8-d86b4ab0b083 tempest-GroupsTest-1816309909 None] Created volume successfully. Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Acquiring lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Acquiring lock "cinder-quobyte-02a6653c-a75e-4de3-9ee7-dbbe2f922472" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Lock "cinder-quobyte-02a6653c-a75e-4de3-9ee7-dbbe2f922472" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c57b1d1-0883-4247-9789-e8ae3750b611]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:24 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:12:24 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:24 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.433s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:24 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472 Sep 28 18:12:24 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-02a6653c-a75e-4de3-9ee7-dbbe2f922472" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Lock "cinder-quobyte-02a6653c-a75e-4de3-9ee7-dbbe2f922472" released by "delete_volume" :: held 0.871s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Created reservations ['9ee4538c-cd1d-4895-a5fb-391c2e6300f0', '73d0dd28-8aab-4aa9-bffb-89fbefe7dbef', '30fe1134-619f-45e1-8a58-d122938778c9', '174ef5cb-6764-413d-82c1-e73dd676d324'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Flow 'volume_create_manager' (ae0ad592-df1c-4143-b95c-f20f7bf3d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483a26dd-8cc6-43ad-a4f9-930e735853d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483a26dd-8cc6-43ad-a4f9-930e735853d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1651021511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2211516b-d8d8-447a-a9be-dc283c68c3a0,host='devstack@QuobyteHD#QuobyteHD',id=b6a38242-a049-418f-afaf-e19f11dab6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50412ab49e6e4d7083f89484d198389e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='cb5eee85a215445eb93ae05f830df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b68b886-4b58-496c-a20e-8136fed0b6ac),volume_type_id=4b68b886-4b58-496c-a20e-8136fed0b6ac)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6222537f-7c8b-4315-9353-e5f6cdbd36a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6222537f-7c8b-4315-9353-e5f6cdbd36a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64419169-0102-4731-8b32-3e7098b74f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64419169-0102-4731-8b32-3e7098b74f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a38242-a049-418f-afaf-e19f11dab6e5', 'volume_name': 'volume-b6a38242-a049-418f-afaf-e19f11dab6e5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f4c1c0-5668-4f7d-a64d-b61b222ae44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f4c1c0-5668-4f7d-a64d-b61b222ae44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d40c88-5f36-4d23-822d-c72b2c7a5d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Volume b6a38242-a049-418f-afaf-e19f11dab6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a38242-a049-418f-afaf-e19f11dab6e5', 'volume_size': 1} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2211516b-d8d8-447a-a9be-dc283c68c3a0,created_at=2026-09-28T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1651021511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2211516b-d8d8-447a-a9be-dc283c68c3a0,host='devstack@QuobyteHD#QuobyteHD',id=b6a38242-a049-418f-afaf-e19f11dab6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50412ab49e6e4d7083f89484d198389e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='cb5eee85a215445eb93ae05f830df83b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b68b886-4b58-496c-a20e-8136fed0b6ac),volume_type_id=4b68b886-4b58-496c-a20e-8136fed0b6ac)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Creating volume b6a38242-a049-418f-afaf-e19f11dab6e5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:25 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 1073741824 Sep 28 18:12:25 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:25 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.355s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Deleted volume successfully. Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-85948119-40f3-405d-879c-dcb3dee00afe tempest-VolumesActionsTest-1167058101 None] Lock "cinder-02a6653c-a75e-4de3-9ee7-dbbe2f922472-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:26 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 1073741824" returned: 0 in 0.562s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 Sep 28 18:12:26 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d40c88-5f36-4d23-822d-c72b2c7a5d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a38242-a049-418f-afaf-e19f11dab6e5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdfb343-542c-485b-9e3d-907cd5daea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:26 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Volume volume-b6a38242-a049-418f-afaf-e19f11dab6e5 (b6a38242-a049-418f-afaf-e19f11dab6e5): created successfully Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdfb343-542c-485b-9e3d-907cd5daea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Flow 'volume_create_manager' (ae0ad592-df1c-4143-b95c-f20f7bf3d04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c49b1bd4-f403-4bcb-9941-26badd216e67 tempest-GroupsTest-1816309909 None] Created volume successfully. Sep 28 18:12:27 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fa361cd9-ec50-45f3-acd1-7eb68fb1f73f tempest-GroupsTest-1816309909 None] Update group completed successfully. Sep 28 18:12:28 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-13bb479c-d56f-46be-896f-68aa9fd81aff tempest-GroupsTest-1816309909 None] Update group completed successfully. Sep 28 18:12:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-42504c57-8c1e-48cb-afa5-0ff12c72794c req-01e43403-73d0-454b-998c-9e6722e75f8a tempest-TestInstancesWithCinderVolumes-773018043 None] Terminate volume connection completed successfully. Sep 28 18:12:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-42504c57-8c1e-48cb-afa5-0ff12c72794c req-01e43403-73d0-454b-998c-9e6722e75f8a tempest-TestInstancesWithCinderVolumes-773018043 None] Deleting attachment c41fc2e0-378d-4493-ba04-7a15e93c2c1b. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "cinder-55dd1b71-c75c-4804-b3cc-54d991bd2788-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-55dd1b71-c75c-4804-b3cc-54d991bd2788-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Acquiring lock "cinder-quobyte-b5f5c518-06dd-407c-9fb5-7620d52c5f6d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "cinder-quobyte-55dd1b71-c75c-4804-b3cc-54d991bd2788" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Lock "cinder-quobyte-b5f5c518-06dd-407c-9fb5-7620d52c5f6d" acquired by "delete_volume" :: waited 0.040s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-quobyte-55dd1b71-c75c-4804-b3cc-54d991bd2788" acquired by "delete_volume" :: waited 0.055s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2849bca-03f4-4b26-9716-ded5bbf7468f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a62e5-6d87-49d2-94b8-c75031d807ff]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:30 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d Sep 28 18:12:30 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:30 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 Sep 28 18:12:30 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d" returned: 0 in 0.635s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788" returned: 0 in 0.630s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d Sep 28 18:12:31 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788 Sep 28 18:12:31 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b5f5c518-06dd-407c-9fb5-7620d52c5f6d" returned: 0 in 0.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Lock "cinder-quobyte-b5f5c518-06dd-407c-9fb5-7620d52c5f6d" released by "delete_volume" :: held 1.045s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Acquiring lock "cinder-quobyte-b6a38242-a049-418f-afaf-e19f11dab6e5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Lock "cinder-quobyte-b6a38242-a049-418f-afaf-e19f11dab6e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:31 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-55dd1b71-c75c-4804-b3cc-54d991bd2788" returned: 0 in 0.353s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3624055-f2b9-4834-97ce-2e6a9fdf32f5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-quobyte-55dd1b71-c75c-4804-b3cc-54d991bd2788" released by "delete_volume" :: held 1.065s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:31 devstack cinder-volume[87096]: WARNING cinder.quota [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861170192-1962931433 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861170192-1962931433, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:31 devstack cinder-volume[87096]: WARNING cinder.quota [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861170192-1962931433 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1861170192-1962931433, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Created reservations ['fc0c68ad-75a1-426b-8ddf-2441c58ff678', '7ea3d607-874c-470b-b2db-955f44aa7bed', '0960cec2-7daf-4f87-b099-7893c6c80e3c', 'e940039d-a653-4e06-a2b8-6562e44c0dbb'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:31 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 Sep 28 18:12:31 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:31 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.330s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Deleted volume successfully. Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bac0c385-0c4f-4374-a764-a86840543e69 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-55dd1b71-c75c-4804-b3cc-54d991bd2788-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5" returned: 0 in 0.655s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5 Sep 28 18:12:32 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6a38242-a049-418f-afaf-e19f11dab6e5" returned: 0 in 0.418s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Lock "cinder-quobyte-b6a38242-a049-418f-afaf-e19f11dab6e5" released by "delete_volume" :: held 1.131s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Created reservations ['12eb78d3-036c-490b-b55e-21977b219c40'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:32 devstack cinder-volume[87096]: WARNING cinder.quota [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-756951564 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-756951564, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:32 devstack cinder-volume[87096]: WARNING cinder.quota [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-756951564 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-756951564, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:32 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Created reservations ['a43a05df-8f7d-4a11-b573-cb11bee36ab6', 'c150cadc-cae1-40c9-adcf-2e0061c8b71b', 'e54f435e-20ed-4937-9b9a-3ae14e0a6c51', '1addf42a-885a-46c6-82b8-9f53a8a75db8'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Created reservations ['cee19f49-b7cc-48c3-bb02-9201b30b3ed3', 'd41c40f0-304c-449d-a1ca-051bd968c9f9', '6935f92e-2aa8-4e9d-afa8-6f1c20364469', 'b1e885ca-c76d-4ad8-99f5-8dedf23ac1af'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:33 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:33 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.320s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:33 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-475f4df2-ad78-40f4-9d4c-9153a73efbc9 tempest-GroupsTest-1816309909 None] Delete group completed successfully. Sep 28 18:12:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-3289bb71-6b8c-4d37-b0fc-9f719b841d95 req-1e6223f3-7ea0-498e-b4d1-adaebd4e40b5 tempest-TestInstancesWithCinderVolumes-773018043 None] Terminate volume connection completed successfully. Sep 28 18:12:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-3289bb71-6b8c-4d37-b0fc-9f719b841d95 req-1e6223f3-7ea0-498e-b4d1-adaebd4e40b5 tempest-TestInstancesWithCinderVolumes-773018043 None] Deleting attachment 8a2519b0-293d-4e6f-8d6f-1c0a6754410b. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:12:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "cinder-6d916bc9-660a-477b-9b06-4d272d9393f0-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-6d916bc9-660a-477b-9b06-4d272d9393f0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "cinder-quobyte-6d916bc9-660a-477b-9b06-4d272d9393f0" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-quobyte-6d916bc9-660a-477b-9b06-4d272d9393f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:36 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cadbd9-ff0b-4d81-bd89-97cce20d4c3b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:36 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 Sep 28 18:12:36 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:37 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0" returned: 0 in 0.611s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0 Sep 28 18:12:37 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:37 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6d916bc9-660a-477b-9b06-4d272d9393f0" returned: 0 in 0.429s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-quobyte-6d916bc9-660a-477b-9b06-4d272d9393f0" released by "delete_volume" :: held 1.139s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:37 devstack cinder-volume[87096]: WARNING cinder.quota [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-969128032-539566188 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-969128032-539566188, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:37 devstack cinder-volume[87096]: WARNING cinder.quota [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-969128032-539566188 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-969128032-539566188, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:37 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Created reservations ['01d4fb04-c0c1-446b-bc37-c93dee34127b', '09fdcd81-fa86-4f3b-8246-dcf90ff2b154', '469867b7-a9f9-4b8c-96f0-4103777134a9', 'ebd08a15-8aca-461e-a74a-0441e30035cc'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:38 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:38 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.397s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Deleted volume successfully. Sep 28 18:12:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-84179c95-02c4-4b18-942a-839851a7190a tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-6d916bc9-660a-477b-9b06-4d272d9393f0-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Flow 'volume_create_manager' (0962f010-9e98-4d7f-bbe9-addd103e3085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f358298-6f02-4a1f-a119-028781d2010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f358298-6f02-4a1f-a119-028781d2010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-588834247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b247d0d2-656e-48e6-9ffe-8dd891204907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fa2acdfc604b66869f7a0e7aaf71b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:39Z,use_quota=True,user_id='0db506724fea4d32bc03cbc5ddb415c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2abfb78-e8c2-414f-8044-77f64c4e52dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2abfb78-e8c2-414f-8044-77f64c4e52dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e461f3-d4c9-4417-b1ad-7c5466ca4d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e461f3-d4c9-4417-b1ad-7c5466ca4d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b247d0d2-656e-48e6-9ffe-8dd891204907', 'volume_name': 'volume-b247d0d2-656e-48e6-9ffe-8dd891204907', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c109ec-f0ef-4163-ac7c-1169f6a28d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c109ec-f0ef-4163-ac7c-1169f6a28d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdfcb916-c1f6-4982-8b78-8d149c3c486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Volume b247d0d2-656e-48e6-9ffe-8dd891204907: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b247d0d2-656e-48e6-9ffe-8dd891204907', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Trying to clone b247d0d2-656e-48e6-9ffe-8dd891204907 from image fadc8935-e87d-4b36-9885-050bf1046672 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:12:40 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca157af2-ef55-46d2-89ee-4145630ff98e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:40 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD Sep 28 18:12:40 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:40 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 is fetched for user 0db506724fea4d32bc03cbc5ddb415c7. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcbb75-e413-4c19-bca8-5b93849fe8d5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:41 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD Sep 28 18:12:41 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:41 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD" returned: 0 in 0.558s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-588834247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b247d0d2-656e-48e6-9ffe-8dd891204907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fa2acdfc604b66869f7a0e7aaf71b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:39Z,use_quota=True,user_id='0db506724fea4d32bc03cbc5ddb415c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Creating volume b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:41 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:12:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:41 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 1073741824 Sep 28 18:12:41 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:42 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 1073741824" returned: 0 in 0.987s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:42 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 Sep 28 18:12:42 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907" returned: 0 in 0.413s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Attempting download of fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume b247d0d2-656e-48e6-9ffe-8dd891204907. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecc905c-967e-4815-b16d-97cac54cfa58]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:43 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj Sep 28 18:12:43 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj Sep 28 18:12:44 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:44 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj" returned: 1 in 0.588s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_oi4xp7xj' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc9dc5-0ca8-48cd-bef5-8a0656c8e9e5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-3ec39a10-e749-48b2-a308-df1241dcaeb1 req-d1241151-ee75-48a8-9f44-6107c8575cff tempest-TestInstancesWithCinderVolumes-773018043 None] Terminate volume connection completed successfully. Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-3ec39a10-e749-48b2-a308-df1241dcaeb1 req-d1241151-ee75-48a8-9f44-6107c8575cff tempest-TestInstancesWithCinderVolumes-773018043 None] Deleting attachment 6b7e04dc-0636-4865-b721-cdd433470032. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:12:44 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD Sep 28 18:12:44 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:44 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] fadc8935-e87d-4b36-9885-050bf1046672 was qcow2, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:12:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 Sep 28 18:12:44 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "cinder-7b78a201-939d-40c1-aecc-63586cba5dce-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-7b78a201-939d-40c1-aecc-63586cba5dce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "cinder-quobyte-7b78a201-939d-40c1-aecc-63586cba5dce" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-quobyte-7b78a201-939d-40c1-aecc-63586cba5dce" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b304e13-0869-4889-b1d2-5ab5aa7dc709]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:46 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce Sep 28 18:12:46 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:46 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce" returned: 0 in 0.534s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:46 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce Sep 28 18:12:46 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:47 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7b78a201-939d-40c1-aecc-63586cba5dce" returned: 0 in 0.393s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-quobyte-7b78a201-939d-40c1-aecc-63586cba5dce" released by "delete_volume" :: held 1.000s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:47 devstack cinder-volume[87096]: WARNING cinder.quota [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1074572414-2135523117 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1074572414-2135523117, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:47 devstack cinder-volume[87096]: WARNING cinder.quota [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1074572414-2135523117 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1074572414-2135523117, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Created reservations ['aef91ef9-e6d9-4a38-ada4-6f09288ea519', '2229f21d-f9ba-4c11-98d0-3cb0af8ebd57', '124b9811-cccd-4e28-bc9e-fc323a902f89', '3591fd01-5b81-426b-8360-d0f432bf8f5e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:47 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:47 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907" returned: 0 in 2.731s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_qfqdnwp1devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:47 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Converted 112.00 MB image at 41.00 MB/s Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.291s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Deleted volume successfully. Sep 28 18:12:47 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 1G Sep 28 18:12:47 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65764137-9570-4fa4-8873-1ce857acd941 tempest-TestInstancesWithCinderVolumes-773018043 None] Lock "cinder-7b78a201-939d-40c1-aecc-63586cba5dce-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:48 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 1G" returned: 0 in 0.424s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Downloaded image fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume b247d0d2-656e-48e6-9ffe-8dd891204907 successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 for user 0db506724fea4d32bc03cbc5ddb415c7 is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Marking volume b247d0d2-656e-48e6-9ffe-8dd891204907 as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Copying metadata from image fadc8935-e87d-4b36-9885-050bf1046672 to b247d0d2-656e-48e6-9ffe-8dd891204907. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Creating volume glance metadata for volume b247d0d2-656e-48e6-9ffe-8dd891204907 backed by image fadc8935-e87d-4b36-9885-050bf1046672 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdfcb916-c1f6-4982-8b78-8d149c3c486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b247d0d2-656e-48e6-9ffe-8dd891204907', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2325c74f-81f0-4660-bfb3-1aaa3e469a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:48 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Volume volume-b247d0d2-656e-48e6-9ffe-8dd891204907 (b247d0d2-656e-48e6-9ffe-8dd891204907): created successfully Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2325c74f-81f0-4660-bfb3-1aaa3e469a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Flow 'volume_create_manager' (0962f010-9e98-4d7f-bbe9-addd103e3085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1a41645c-37f4-48c1-a6da-c6057be8b21c tempest-VolumesExtendTest-1152946227 None] Created volume successfully. Sep 28 18:12:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[249ad518-e56c-40ce-b143-ac6ba6b27b01]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 Sep 28 18:12:49 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 2G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 2G" returned: 0 in 0.161s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.702s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f21fae0c-245c-49b7-ba0c-bdc0a24ed724 tempest-VolumesExtendTest-1152946227 None] Extend volume completed successfully. Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-b247d0d2-656e-48e6-9ffe-8dd891204907-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Lock "cinder-b247d0d2-656e-48e6-9ffe-8dd891204907-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-quobyte-b247d0d2-656e-48e6-9ffe-8dd891204907" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-b247d0d2-656e-48e6-9ffe-8dd891204907" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80647b-4032-4c55-b67c-6e1ad75d7ce0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:51 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 Sep 28 18:12:51 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:51 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907" returned: 0 in 0.581s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:51 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907 Sep 28 18:12:51 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b247d0d2-656e-48e6-9ffe-8dd891204907" returned: 0 in 0.366s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-b247d0d2-656e-48e6-9ffe-8dd891204907" released by "delete_volume" :: held 1.018s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Created reservations ['2c4f099c-db94-4476-8346-09c71ff85cb4', 'cfef3110-f4ff-450b-aba1-593c7a1b9dcd', 'd9c74fd1-dc8b-4291-923a-211651e3734b', 'b515b33a-25b0-423e-b26f-6c029353ae20'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:52 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:12:52 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.317s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Deleted volume successfully. Sep 28 18:12:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4f02d618-c197-4e19-9084-9d7b4dfebddf tempest-VolumesExtendTest-1152946227 None] Lock "cinder-b247d0d2-656e-48e6-9ffe-8dd891204907-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Flow 'volume_create_manager' (c529b214-39e4-4c04-b6e0-53333f02b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5dbe36-bd3c-411f-ac82-40778f3627b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5dbe36-bd3c-411f-ac82-40778f3627b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-534082382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a1cb25-6d13-4df9-916b-872739ed4e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fa2acdfc604b66869f7a0e7aaf71b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:54Z,use_quota=True,user_id='0db506724fea4d32bc03cbc5ddb415c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db2cfbb-5a2e-466d-92c0-435910959c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db2cfbb-5a2e-466d-92c0-435910959c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d294f8e8-b9c0-4775-9c06-c7152302c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d294f8e8-b9c0-4775-9c06-c7152302c727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a1cb25-6d13-4df9-916b-872739ed4e75', 'volume_name': 'volume-95a1cb25-6d13-4df9-916b-872739ed4e75', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cc7da0-008e-44f9-91e7-d146c6a6024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cc7da0-008e-44f9-91e7-d146c6a6024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02fd035-3127-41dd-9047-cf2f9a3d6ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Volume 95a1cb25-6d13-4df9-916b-872739ed4e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a1cb25-6d13-4df9-916b-872739ed4e75', 'volume_size': 1} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-534082382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a1cb25-6d13-4df9-916b-872739ed4e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fa2acdfc604b66869f7a0e7aaf71b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:54Z,use_quota=True,user_id='0db506724fea4d32bc03cbc5ddb415c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Creating volume 95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:54 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:54 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 1073741824 Sep 28 18:12:54 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:54 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 1073741824" returned: 0 in 0.679s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:55 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 Sep 28 18:12:55 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:55 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75" returned: 0 in 0.434s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02fd035-3127-41dd-9047-cf2f9a3d6ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a1cb25-6d13-4df9-916b-872739ed4e75', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c470d3-a30c-47e8-a5b6-e6771fb09a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Volume volume-95a1cb25-6d13-4df9-916b-872739ed4e75 (95a1cb25-6d13-4df9-916b-872739ed4e75): created successfully Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c470d3-a30c-47e8-a5b6-e6771fb09a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Flow 'volume_create_manager' (c529b214-39e4-4c04-b6e0-53333f02b18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-928da9f2-dcf9-4a31-91ed-ab0277c4ae72 tempest-VolumesExtendTest-1152946227 None] Created volume successfully. Sep 28 18:12:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Creating offline snapshot a311bd21-398e-4a41-aa30-4b3c602d85e9 of volume 95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ce244-09eb-4b77-b069-b9cc94b5a272]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:56 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 Sep 28 18:12:56 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:57 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75" returned: 0 in 0.504s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:57 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 1G Sep 28 18:12:57 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:57 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 1G" returned: 0 in 0.599s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a1cb25-6d13-4df9-916b-872739ed4e75 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:57 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a1cb25-6d13-4df9-916b-872739ed4e75 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 Sep 28 18:12:57 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:58 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95a1cb25-6d13-4df9-916b-872739ed4e75 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9" returned: 0 in 0.419s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:58 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 is being set with open permissions: ugo+rw Sep 28 18:12:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:58 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 Sep 28 18:12:58 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:58 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9" returned: 0 in 0.339s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:58 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info Sep 28 18:12:58 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:58 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info" returned: 0 in 0.304s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:58 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info is being set with open permissions: ugo+rw Sep 28 18:12:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:58 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info Sep 28 18:12:58 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:59 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.info" returned: 0 in 0.313s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-168afd43-72dd-44e8-b014-98a2b75413f3 tempest-VolumesExtendTest-1152946227 None] Create snapshot completed successfully Sep 28 18:12:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7252eff-07b6-45c0-bd4e-b450c79ab768]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:59 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 Sep 28 18:12:59 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:00 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75" returned: 0 in 0.429s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 2G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 2G" returned: 0 in 0.219s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.708s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-02634142-e7e0-4f31-b4f9-c13dcabd5bba tempest-VolumesExtendTest-1152946227 None] Extend volume completed successfully. Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-a311bd21-398e-4a41-aa30-4b3c602d85e9-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Lock "cinder-a311bd21-398e-4a41-aa30-4b3c602d85e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-quobyte-95a1cb25-6d13-4df9-916b-872739ed4e75" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-95a1cb25-6d13-4df9-916b-872739ed4e75" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-quobyte-a311bd21-398e-4a41-aa30-4b3c602d85e9" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-a311bd21-398e-4a41-aa30-4b3c602d85e9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Deleting offline snapshot a311bd21-398e-4a41-aa30-4b3c602d85e9 of volume 95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] snapshot_file for this snap is: volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff270b-051f-4123-a0c4-83eba8a64824]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:01 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 Sep 28 18:13:01 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9" returned: 0 in 0.627s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95a1cb25-6d13-4df9-916b-872739ed4e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a559d25-22e5-48ea-9acb-3c237af34d77]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:02 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 Sep 28 18:13:02 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:02 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75" returned: 0 in 0.659s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:02 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 Sep 28 18:13:02 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:03 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9" returned: 0 in 0.554s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9 Sep 28 18:13:03 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:03 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Flow 'volume_create_manager' (76763835-6753-4ab9-bbd4-44df884ba16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e28397-db1a-4b18-a768-2617aa849783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75.a311bd21-398e-4a41-aa30-4b3c602d85e9" returned: 0 in 0.493s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e28397-db1a-4b18-a768-2617aa849783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-216425377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fc3fa8-83bd-4c93-9963-2d135cc46408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9f844dcf834c5699e91a0393f6ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:04Z,use_quota=True,user_id='6f0bdcf86fe04f078a45e855af24631d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be84af68-7848-47ec-827e-f699ea184b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be84af68-7848-47ec-827e-f699ea184b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cfaa4c-2efe-4962-8208-8a061ee9ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cfaa4c-2efe-4962-8208-8a061ee9ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fc3fa8-83bd-4c93-9963-2d135cc46408', 'volume_name': 'volume-30fc3fa8-83bd-4c93-9963-2d135cc46408', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f8a216-e8bd-4bed-8cfd-3b274a908755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f8a216-e8bd-4bed-8cfd-3b274a908755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007138ec-8491-4f8d-a9ef-19f4ae7478a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Volume 30fc3fa8-83bd-4c93-9963-2d135cc46408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fc3fa8-83bd-4c93-9963-2d135cc46408', 'volume_size': 1} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-216425377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fc3fa8-83bd-4c93-9963-2d135cc46408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9f844dcf834c5699e91a0393f6ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:04Z,use_quota=True,user_id='6f0bdcf86fe04f078a45e855af24631d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Creating volume 30fc3fa8-83bd-4c93-9963-2d135cc46408 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:03 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 1073741824 Sep 28 18:13:03 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-a311bd21-398e-4a41-aa30-4b3c602d85e9" released by "_delete_snapshot" :: held 2.600s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-95a1cb25-6d13-4df9-916b-872739ed4e75" released by "delete_snapshot" :: held 2.641s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:03 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Created reservations ['79de91c1-1544-4c16-a7f2-e9ececf10212', 'b031822b-7b74-4816-9b8e-1b24cb4dcacf', '6eda5b06-d564-412f-a34c-74748ba0eba2', '0af57393-af57-4913-8c30-73180517cc35'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Delete snapshot completed successfully. Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5cdb8d39-0e04-4429-bf28-187e0437399a tempest-VolumesExtendTest-1152946227 None] Lock "cinder-a311bd21-398e-4a41-aa30-4b3c602d85e9-delete_snapshot" released by "delete_snapshot" :: held 2.854s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:04 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 1073741824" returned: 0 in 0.690s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:04 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 Sep 28 18:13:04 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-95a1cb25-6d13-4df9-916b-872739ed4e75-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Lock "cinder-95a1cb25-6d13-4df9-916b-872739ed4e75-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "cinder-quobyte-95a1cb25-6d13-4df9-916b-872739ed4e75" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-95a1cb25-6d13-4df9-916b-872739ed4e75" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8022a750-5056-4a2d-bc51-4bac73e7a5f0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:05 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408" returned: 0 in 0.506s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007138ec-8491-4f8d-a9ef-19f4ae7478a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fc3fa8-83bd-4c93-9963-2d135cc46408', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9b3b4a-e774-4a19-918a-0c8e566bad71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Volume volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 (30fc3fa8-83bd-4c93-9963-2d135cc46408): created successfully Sep 28 18:13:05 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 Sep 28 18:13:05 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9b3b4a-e774-4a19-918a-0c8e566bad71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Flow 'volume_create_manager' (76763835-6753-4ab9-bbd4-44df884ba16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3925c0dc-c8cc-4e45-820b-31b98f2a9632 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Created volume successfully. Sep 28 18:13:05 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75" returned: 0 in 0.633s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:05 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75 Sep 28 18:13:05 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "cinder-30fc3fa8-83bd-4c93-9963-2d135cc46408-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "cinder-30fc3fa8-83bd-4c93-9963-2d135cc46408-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:05 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-95a1cb25-6d13-4df9-916b-872739ed4e75" returned: 0 in 0.393s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "cinder-quobyte-30fc3fa8-83bd-4c93-9963-2d135cc46408" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Lock "cinder-quobyte-95a1cb25-6d13-4df9-916b-872739ed4e75" released by "delete_volume" :: held 1.138s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "cinder-quobyte-30fc3fa8-83bd-4c93-9963-2d135cc46408" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b01bc-6a37-4b4d-824b-dc651f63e82b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Created reservations ['fd307c52-a301-4caf-a379-a9760c2510c4', '11d40a37-a7c3-4087-875c-78cc2fb78761', '92791a6c-9978-41b0-afa4-aad757050f3c', '45db5ad7-bb31-4d41-b5a1-6ddd7073e22c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:06 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 Sep 28 18:13:06 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:06 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408" returned: 0 in 0.454s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:06 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.330s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:06 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408 Sep 28 18:13:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Deleted volume successfully. Sep 28 18:13:06 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0fee46c-f1c8-4186-863f-18fe3c8a57c7 tempest-VolumesExtendTest-1152946227 None] Lock "cinder-95a1cb25-6d13-4df9-916b-872739ed4e75-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:06 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-30fc3fa8-83bd-4c93-9963-2d135cc46408" returned: 0 in 0.322s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "cinder-quobyte-30fc3fa8-83bd-4c93-9963-2d135cc46408" released by "delete_volume" :: held 0.838s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:06 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Created reservations ['cf9dd90e-0725-42c4-a755-9dc6681e9006', '55a75792-abb8-470b-bfd9-54de4850514a', '011a5955-d616-434c-af61-85bc192339c1', '7289037d-0efb-4f21-9b04-d5339e06dfed'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:07 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:07 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:07 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.382s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Deleted volume successfully. Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5446fdf-f590-4f29-b16a-11f2fca6e34b tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "cinder-30fc3fa8-83bd-4c93-9963-2d135cc46408-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=117,cinder:UPDATE=123,cinder:INSERT=37,cinder:DELETE=5 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=114,cinder:UPDATE=129,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Flow 'volume_create_manager' (2d67dd1b-28f3-4c58-be2f-41e550208225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ab9f65-9fb7-468d-87d4-8811669b333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ab9f65-9fb7-468d-87d4-8811669b333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-986697425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196ee2aa-cba9-4a50-876c-8e87ca43f0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9f844dcf834c5699e91a0393f6ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:08Z,use_quota=True,user_id='6f0bdcf86fe04f078a45e855af24631d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e08a85d-2eaf-43d0-925c-14468407ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e08a85d-2eaf-43d0-925c-14468407ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19516f-d061-425f-8ba2-ce1a3f74d7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba19516f-d061-425f-8ba2-ce1a3f74d7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196ee2aa-cba9-4a50-876c-8e87ca43f0cb', 'volume_name': 'volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64268617-7437-434c-8779-b1fe5001a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64268617-7437-434c-8779-b1fe5001a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c8705-5a75-487e-8e49-30e0446dc723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Volume 196ee2aa-cba9-4a50-876c-8e87ca43f0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb', 'volume_size': 1} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-986697425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196ee2aa-cba9-4a50-876c-8e87ca43f0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d9f844dcf834c5699e91a0393f6ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:08Z,use_quota=True,user_id='6f0bdcf86fe04f078a45e855af24631d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Creating volume 196ee2aa-cba9-4a50-876c-8e87ca43f0cb {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:08 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:08 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb 1073741824 Sep 28 18:13:08 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:08 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb 1073741824" returned: 0 in 0.620s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:08 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb Sep 28 18:13:08 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:09 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb" returned: 0 in 0.346s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c8705-5a75-487e-8e49-30e0446dc723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260b45f0-9697-41a6-ab16-0d1d6268011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Volume volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb (196ee2aa-cba9-4a50-876c-8e87ca43f0cb): created successfully Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260b45f0-9697-41a6-ab16-0d1d6268011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Flow 'volume_create_manager' (2d67dd1b-28f3-4c58-be2f-41e550208225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-90c9c322-5757-49ec-97b7-cad0bbe8e357 tempest-VolumeQuotasAdminTestJSON-2122064607 None] Created volume successfully. Sep 28 18:13:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e5e23671-4805-41f4-a719-46f3f8efc27c tempest-VolumeQuotasAdminTestJSON-1907371318 None] Transfer volume completed successfully. Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Acquiring lock "cinder-196ee2aa-cba9-4a50-876c-8e87ca43f0cb-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Lock "cinder-196ee2aa-cba9-4a50-876c-8e87ca43f0cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Acquiring lock "cinder-quobyte-196ee2aa-cba9-4a50-876c-8e87ca43f0cb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Lock "cinder-quobyte-196ee2aa-cba9-4a50-876c-8e87ca43f0cb" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a88106-dc36-4653-860c-6315e6b544d4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (56cca136-c74f-4f1c-aeb8-9a5d074941db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81797857-c62e-4103-ad5a-1a78c5c6e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81797857-c62e-4103-ad5a-1a78c5c6e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1075564191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:12Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aaf9476-d650-4442-942e-62f5a3119611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aaf9476-d650-4442-942e-62f5a3119611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2cc66c-f855-433b-81ad-b8bd90e8db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2cc66c-f855-433b-81ad-b8bd90e8db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa', 'volume_name': 'volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27adf07-4444-4849-9d95-b077651436e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27adf07-4444-4849-9d95-b077651436e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf2c5aa-a796-4e61-b4c4-9d4b0978cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Volume e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa', 'volume_size': 1} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1075564191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:12Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Creating volume e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:12 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb Sep 28 18:13:12 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:12 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:12 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa 1073741824 Sep 28 18:13:12 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Flow 'volume_create_manager' (c30aab6d-9cf7-41d6-ac42-150e9747f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71b3c51-1592-4442-b3e7-6ac36d0a36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71b3c51-1592-4442-b3e7-6ac36d0a36b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06aa3b3-d0b9-442d-b44d-945c75daa0b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcebe25ce3c54518bd78e5d316c5e255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:13Z,use_quota=True,user_id='f68cdd04fab04f239aa9c02d67e15e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae9bf9b0-af57-47a3-b6ab-263cdd1b3556),volume_type_id=ae9bf9b0-af57-47a3-b6ab-263cdd1b3556)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543abaa8-f55b-4e64-86f2-fb0c77d3cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543abaa8-f55b-4e64-86f2-fb0c77d3cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:12 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68439c82-cd31-4137-ab80-6ad887e3f31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb" returned: 0 in 0.537s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:12 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb Sep 28 18:13:12 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa 1073741824" returned: 0 in 0.637s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:13 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa Sep 28 18:13:13 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-196ee2aa-cba9-4a50-876c-8e87ca43f0cb" returned: 0 in 0.364s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Lock "cinder-quobyte-196ee2aa-cba9-4a50-876c-8e87ca43f0cb" released by "delete_volume" :: held 1.004s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Created reservations ['da51d2c1-2b6e-4bf3-8370-9739fed8391d', '5f717e1d-dd83-47d4-8a9c-3249ac75852f', '51909fee-fb61-4bd4-95e8-496e50f89455', '713eb63f-8a4d-45e4-a4a2-9161364339b3'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68439c82-cd31-4137-ab80-6ad887e3f31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c06aa3b3-d0b9-442d-b44d-945c75daa0b9', 'volume_name': 'volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9', 'volume_size': 1, 'image_id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07d09ff9e1095758767438ff8bdd08d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bcebe25ce3c54518bd78e5d316c5e255', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd45948256df563742bb6792929fe90de71ce181708e04af1299e82ba8c30c5f30a4a2827d94b87211b3c85292f48906b0fbd2ca433dcfcb43e5b06fdef30e54a', 'id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'created_at': datetime.datetime(2026, 9, 28, 16, 13, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 13, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8700ccb-c707-4bfd-9064-de147d25d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8700ccb-c707-4bfd-9064-de147d25d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323be58e-f709-44f9-8992-5f747fb85e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:13 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Volume c06aa3b3-d0b9-442d-b44d-945c75daa0b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9', 'volume_size': 1, 'image_id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07d09ff9e1095758767438ff8bdd08d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bcebe25ce3c54518bd78e5d316c5e255', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd45948256df563742bb6792929fe90de71ce181708e04af1299e82ba8c30c5f30a4a2827d94b87211b3c85292f48906b0fbd2ca433dcfcb43e5b06fdef30e54a', 'id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'created_at': datetime.datetime(2026, 9, 28, 16, 13, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 13, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Trying to clone c06aa3b3-d0b9-442d-b44d-945c75daa0b9 from image b1aa1518-18f3-4e4a-bdec-dcb07f34035f at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:13 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa" returned: 0 in 0.366s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:13:13 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:13:13 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:13 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf2c5aa-a796-4e61-b4c4-9d4b0978cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27a507f-5824-4070-a709-3e0b6c0dbce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:13 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Volume volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa (e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa): created successfully Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27a507f-5824-4070-a709-3e0b6c0dbce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (56cca136-c74f-4f1c-aeb8-9a5d074941db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9b4a5-47b2-44f1-888c-a13d12e71fd4]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:13 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b78e54ed-9ac1-4831-9c5e-9bf29a3c2d99 tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:13:13 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD Sep 28 18:13:13 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.319s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:13 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Deleted volume successfully. Sep 28 18:13:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e78bc48b-bd5f-439b-b244-239259582089 tempest-VolumeQuotasAdminTestJSON-1240763641 None] Lock "cinder-196ee2aa-cba9-4a50-876c-8e87ca43f0cb-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:14 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:14 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD Sep 28 18:13:14 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:14 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Temporary image b1aa1518-18f3-4e4a-bdec-dcb07f34035f is fetched for user f68cdd04fab04f239aa9c02d67e15e39. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa24d31a-7a44-4fe3-900e-46487f3a9b57]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:14 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD Sep 28 18:13:14 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:15 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:15 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD Sep 28 18:13:15 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:15 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD" returned: 1 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06aa3b3-d0b9-442d-b44d-945c75daa0b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcebe25ce3c54518bd78e5d316c5e255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:13Z,use_quota=True,user_id='f68cdd04fab04f239aa9c02d67e15e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae9bf9b0-af57-47a3-b6ab-263cdd1b3556),volume_type_id=ae9bf9b0-af57-47a3-b6ab-263cdd1b3556)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Creating volume c06aa3b3-d0b9-442d-b44d-945c75daa0b9 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:15 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:15 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 1073741824 Sep 28 18:13:15 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (33b0d0d4-87c0-4483-8b2a-0477fee8d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e881f8-1ab1-4660-9bd3-f215f8089f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e881f8-1ab1-4660-9bd3-f215f8089f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2141368050',display_name='tempest-VolumesGetTest-Volume-548756716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68036d43-4742-4173-aff6-6d14c6c70d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:16Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e8fc52-f1a4-4387-a1b3-ded3aa6aaa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e8fc52-f1a4-4387-a1b3-ded3aa6aaa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f2a4d5-0481-4f17-8cef-464d2564b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f2a4d5-0481-4f17-8cef-464d2564b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68036d43-4742-4173-aff6-6d14c6c70d1b', 'volume_name': 'volume-68036d43-4742-4173-aff6-6d14c6c70d1b', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dac4de-6c1e-4710-87d0-6ad12ffc443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dac4de-6c1e-4710-87d0-6ad12ffc443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8b0c4f-b8be-484f-b99b-965d2b47be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Volume 68036d43-4742-4173-aff6-6d14c6c70d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68036d43-4742-4173-aff6-6d14c6c70d1b', 'volume_size': 1} Sep 28 18:13:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:16 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 1073741824" returned: 0 in 0.559s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:16 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 Sep 28 18:13:16 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:16 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" returned: 0 in 0.330s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2141368050',display_name='tempest-VolumesGetTest-Volume-548756716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68036d43-4742-4173-aff6-6d14c6c70d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:16Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Creating volume 68036d43-4742-4173-aff6-6d14c6c70d1b {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:16 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:16 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b 1073741824 Sep 28 18:13:16 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Attempting download of b1aa1518-18f3-4e4a-bdec-dcb07f34035f ((None, [{'url': 'file:///opt/stack/data/glance/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'metadata': {}}])) to volume c06aa3b3-d0b9-442d-b44d-945c75daa0b9. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6bc383-1df6-49c5-8830-45b16e0ea70a]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:16 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq Sep 28 18:13:16 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq" returned: 0 in 0.504s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b 1073741824" returned: 0 in 0.675s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b Sep 28 18:13:17 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq Sep 28 18:13:17 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b" returned: 0 in 0.360s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8b0c4f-b8be-484f-b99b-965d2b47be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68036d43-4742-4173-aff6-6d14c6c70d1b', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b16dde1-aff7-4fa5-9d2e-a6c02b07b428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:17 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Volume volume-68036d43-4742-4173-aff6-6d14c6c70d1b (68036d43-4742-4173-aff6-6d14c6c70d1b): created successfully Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b16dde1-aff7-4fa5-9d2e-a6c02b07b428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:17 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (33b0d0d4-87c0-4483-8b2a-0477fee8d05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq" returned: 1 in 0.539s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_sco1e9tq' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8459d0e2-07dd-4ba2-9fae-90771c0e28e9]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0cd3c7da-7b7a-45c1-940c-4af9fea2b319 tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:13:17 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD Sep 28 18:13:17 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:18 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD Sep 28 18:13:18 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:13:18 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] b1aa1518-18f3-4e4a-bdec-dcb07f34035f was raw, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:13:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:18 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 Sep 28 18:13:18 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-68036d43-4742-4173-aff6-6d14c6c70d1b-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Lock "cinder-68036d43-4742-4173-aff6-6d14c6c70d1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-68036d43-4742-4173-aff6-6d14c6c70d1b" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-68036d43-4742-4173-aff6-6d14c6c70d1b" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:19 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" returned: 0 in 0.634s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1aa1518-18f3-4e4a-bdec-dcb07f34035f_4gn19y_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:13:19 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83b79c0-fb0b-4b04-81f2-9e5ce2e1c60f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:19 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 1G Sep 28 18:13:19 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:19 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b Sep 28 18:13:19 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:19 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 1G" returned: 0 in 0.441s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Downloaded image b1aa1518-18f3-4e4a-bdec-dcb07f34035f ((None, [{'url': 'file:///opt/stack/data/glance/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'metadata': {}}])) to volume c06aa3b3-d0b9-442d-b44d-945c75daa0b9 successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Temporary image b1aa1518-18f3-4e4a-bdec-dcb07f34035f for user f68cdd04fab04f239aa9c02d67e15e39 is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Marking volume c06aa3b3-d0b9-442d-b44d-945c75daa0b9 as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:13:19 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Copying metadata from image b1aa1518-18f3-4e4a-bdec-dcb07f34035f to c06aa3b3-d0b9-442d-b44d-945c75daa0b9. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Creating volume glance metadata for volume c06aa3b3-d0b9-442d-b44d-945c75daa0b9 backed by image b1aa1518-18f3-4e4a-bdec-dcb07f34035f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '07d09ff9e1095758767438ff8bdd08d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:19 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b Sep 28 18:13:19 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323be58e-f709-44f9-8992-5f747fb85e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9', 'volume_size': 1, 'image_id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07d09ff9e1095758767438ff8bdd08d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bcebe25ce3c54518bd78e5d316c5e255', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd45948256df563742bb6792929fe90de71ce181708e04af1299e82ba8c30c5f30a4a2827d94b87211b3c85292f48906b0fbd2ca433dcfcb43e5b06fdef30e54a', 'id': 'b1aa1518-18f3-4e4a-bdec-dcb07f34035f', 'created_at': datetime.datetime(2026, 9, 28, 16, 13, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 13, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1aa1518-18f3-4e4a-bdec-dcb07f34035f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbe95e4-2712-4baf-9bb8-da2fbd1dcca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:19 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Volume volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 (c06aa3b3-d0b9-442d-b44d-945c75daa0b9): created successfully Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbe95e4-2712-4baf-9bb8-da2fbd1dcca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Flow 'volume_create_manager' (c30aab6d-9cf7-41d6-ac42-150e9747f258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7338bd92-9358-4209-b5ff-e2b5c0ad2f9a tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Created volume successfully. Sep 28 18:13:19 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-68036d43-4742-4173-aff6-6d14c6c70d1b" returned: 0 in 0.309s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-68036d43-4742-4173-aff6-6d14c6c70d1b" released by "delete_volume" :: held 0.854s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Created reservations ['f14382c0-13cc-419c-82cd-a3d0af980c0d', 'c31999d7-c8e8-428a-a40b-13ae3be6fabe', '31353f73-f5ae-4448-9c21-f3b5c5002190', '4790ef82-4c2f-4faa-afc9-35a24f02a665'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:20 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:20 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Lock "cinder-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Acquiring lock "cinder-c06aa3b3-d0b9-442d-b44d-945c75daa0b9-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "cinder-c06aa3b3-d0b9-442d-b44d-945c75daa0b9-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa" acquired by "delete_volume" :: waited 0.040s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Acquiring lock "cinder-quobyte-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[82412679-1095-4d95-9e9d-2dfce83a38e2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:20 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "cinder-quobyte-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" acquired by "delete_volume" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.549s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:20 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a45c6fe-f452-4b53-8d67-808494538e90]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:20 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa Sep 28 18:13:20 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-56b00484-76a1-4e63-9470-63381608b739 tempest-VolumesGetTest-1123124467 None] Lock "cinder-68036d43-4742-4173-aff6-6d14c6c70d1b-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:20 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 Sep 28 18:13:20 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa" returned: 0 in 0.547s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:21 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa Sep 28 18:13:21 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" returned: 0 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:21 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9 Sep 28 18:13:21 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" returned: 0 in 0.352s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa" returned: 0 in 0.419s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "cinder-quobyte-c06aa3b3-d0b9-442d-b44d-945c75daa0b9" released by "delete_volume" :: held 0.942s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa" released by "delete_volume" :: held 1.050s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:21 devstack cinder-volume[87096]: WARNING cinder.quota [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:13:21 devstack cinder-volume[87096]: WARNING cinder.quota [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Created reservations ['44a23a77-6fc8-4265-b702-547230fb152d', '7fadcc35-3d19-4a5b-a28b-175f4d39cceb', '6b086dfd-39ad-4cbb-9de4-92e95a81a93e', 'c090376d-c3aa-4846-8fd1-e64977a7610f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Created reservations ['ebd0142f-1482-4745-8956-353ec8ff5318', '478e7bf8-d2fd-407e-8493-75566e1bd92b', '6e6dbb2f-9af5-42f5-9b71-1fa2cbd9f021', 'c30724ac-6740-49d7-87f3-03c121a7994e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:21 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:21 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:21 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:21 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:22 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.357s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:22 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:22 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Deleted volume successfully. Sep 28 18:13:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6a6a906b-e5b8-4c6e-ae27-de0d19443b77 tempest-VolumeAndVolumeTypeFromImageTest-1514521481 None] Lock "cinder-c06aa3b3-d0b9-442d-b44d-945c75daa0b9-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:22 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.413s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:22 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:22 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:13:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f017f61b-f950-48d3-950c-b29631ffc763 tempest-VolumesGetTest-1123124467 None] Lock "cinder-e62d5a45-cdf8-4bcd-a7bd-4141cc19feaa-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (2ca8b53a-a111-4513-bda7-afb80c38f907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea2e87f-09db-474d-99e3-2a8433e7c9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea2e87f-09db-474d-99e3-2a8433e7c9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-975860049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e196088-ff36-4670-a3a0-ef661659c384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:23Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab6b2fb-3960-4066-9198-442de6a0aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ab6b2fb-3960-4066-9198-442de6a0aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0542eb2-92ae-4a1e-ac29-771fa72f5177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0542eb2-92ae-4a1e-ac29-771fa72f5177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e196088-ff36-4670-a3a0-ef661659c384', 'volume_name': 'volume-5e196088-ff36-4670-a3a0-ef661659c384', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d49a64-3ed0-470a-88c8-5149cb116913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d49a64-3ed0-470a-88c8-5149cb116913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1236d074-9d1c-4077-b273-25a2935cdafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:23 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Volume 5e196088-ff36-4670-a3a0-ef661659c384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e196088-ff36-4670-a3a0-ef661659c384', 'volume_size': 1} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-975860049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e196088-ff36-4670-a3a0-ef661659c384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:23Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Creating volume 5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:23 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:23 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 1073741824 Sep 28 18:13:23 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:23 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:23 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:24 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.391s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:13:24 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 1073741824" returned: 0 in 0.692s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:24 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 Sep 28 18:13:24 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:24 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384" returned: 0 in 0.409s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1236d074-9d1c-4077-b273-25a2935cdafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e196088-ff36-4670-a3a0-ef661659c384', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81bc605-de81-427c-abe3-efdb5be7d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:24 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Volume volume-5e196088-ff36-4670-a3a0-ef661659c384 (5e196088-ff36-4670-a3a0-ef661659c384): created successfully Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81bc605-de81-427c-abe3-efdb5be7d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (2ca8b53a-a111-4513-bda7-afb80c38f907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9e35da45-29dd-4417-a8ed-8199cc0b059d tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (4a8efc35-5393-44bf-9f13-1086a1ebb854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a461628-13e0-476e-b6e3-a7208f758932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a461628-13e0-476e-b6e3-a7208f758932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-658295014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5e196088-ff36-4670-a3a0-ef661659c384,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:26Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687cc72a-20eb-4a1d-a31c-8de10c98c19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687cc72a-20eb-4a1d-a31c-8de10c98c19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe66c485-0c0a-4070-b25f-c98071bfb764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe66c485-0c0a-4070-b25f-c98071bfb764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0', 'volume_name': 'volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0', 'volume_size': 1, 'source_volid': '5e196088-ff36-4670-a3a0-ef661659c384', 'source_volstatus': 'available'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aafccb2-300b-4bab-b8b9-be4029bcbf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aafccb2-300b-4bab-b8b9-be4029bcbf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490abb08-0fb2-4d4b-b512-09a9450949d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Volume ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0', 'volume_size': 1, 'source_volid': '5e196088-ff36-4670-a3a0-ef661659c384', 'source_volstatus': 'available'} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:26 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Cloning volume 5e196088-ff36-4670-a3a0-ef661659c384 to volume ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Creating offline snapshot 2ff1591f-127d-4ca7-87c0-af08732f1d9f of volume 5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f0a49-a8fe-43bf-ab60-329109808b5b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Flow 'volume_create_manager' (97ad39a2-c054-4f61-b468-84079d7f2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2f44d7-f015-48ae-a4ed-84987f5a6a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2f44d7-f015-48ae-a4ed-84987f5a6a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-12255306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c708fe-ba96-46d5-986d-6a6a66948d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968162236b3b431a88c2c00310413352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:27Z,use_quota=True,user_id='92115d7cabbe42d892430eebbc2aabf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31631b47-55e1-438e-a1d4-0fbd4c62ad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31631b47-55e1-438e-a1d4-0fbd4c62ad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f65128-e9ad-4d0b-984a-b4384b660dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f65128-e9ad-4d0b-984a-b4384b660dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c708fe-ba96-46d5-986d-6a6a66948d20', 'volume_name': 'volume-b2c708fe-ba96-46d5-986d-6a6a66948d20', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b20d6bc-3e11-46b5-885e-4c2b49f125bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 Sep 28 18:13:26 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b20d6bc-3e11-46b5-885e-4c2b49f125bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d08fca-a352-4dee-88aa-f86b25a97ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:26 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Volume b2c708fe-ba96-46d5-986d-6a6a66948d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c708fe-ba96-46d5-986d-6a6a66948d20', 'volume_size': 1} Sep 28 18:13:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:27 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384" returned: 0 in 0.438s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:27 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f 1G Sep 28 18:13:27 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:27 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f 1G" returned: 0 in 0.609s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e196088-ff36-4670-a3a0-ef661659c384 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:27 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e196088-ff36-4670-a3a0-ef661659c384 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f Sep 28 18:13:27 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:27 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e196088-ff36-4670-a3a0-ef661659c384 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f" returned: 0 in 0.345s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:28 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f is being set with open permissions: ugo+rw Sep 28 18:13:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:28 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f Sep 28 18:13:28 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:28 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f" returned: 0 in 0.344s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:28 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info Sep 28 18:13:28 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:28 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info" returned: 0 in 0.332s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:28 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info is being set with open permissions: ugo+rw Sep 28 18:13:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:28 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info Sep 28 18:13:28 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:29 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.info" returned: 0 in 0.287s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] snapshot: 2ff1591f-127d-4ca7-87c0-af08732f1d9f, volume: ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9a1920-1623-4efd-a91c-1294e4431754]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:29 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f Sep 28 18:13:29 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (55975448-2772-477b-873a-052f015f1cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934770c9-b8b6-4257-b9e3-e14d62f06413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934770c9-b8b6-4257-b9e3-e14d62f06413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7968624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d8e15-3111-4a05-b310-d6a67a5b8662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:29Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e0e58f-4449-43f8-9d70-51951f0bde09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e0e58f-4449-43f8-9d70-51951f0bde09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c606a670-2cd2-4e12-9f21-f03bed14c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c606a670-2cd2-4e12-9f21-f03bed14c183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403d8e15-3111-4a05-b310-d6a67a5b8662', 'volume_name': 'volume-403d8e15-3111-4a05-b310-d6a67a5b8662', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3575c6-900e-49c8-9013-6cb5279370fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3575c6-900e-49c8-9013-6cb5279370fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba23604-a9da-46e9-9f35-d8757bffff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:29 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume 403d8e15-3111-4a05-b310-d6a67a5b8662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403d8e15-3111-4a05-b310-d6a67a5b8662', 'volume_size': 1} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:29 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f" returned: 0 in 0.442s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e196088-ff36-4670-a3a0-ef661659c384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb446bd-a9e6-425a-978e-a27326951fd4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:29 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 Sep 28 18:13:29 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:29 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:13:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:30 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 Sep 28 18:13:30 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:36 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" returned: 0 in 6.672s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:13:36 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Converted 1024.00 MB image at 153.46 MB/s Sep 28 18:13:36 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 is being set with open permissions: ugo+rw Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:36 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 Sep 28 18:13:36 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:36 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" released by "_copy_volume_from_snapshot" :: held 7.906s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-2ff1591f-127d-4ca7-87c0-af08732f1d9f" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-2ff1591f-127d-4ca7-87c0-af08732f1d9f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Deleting offline snapshot 2ff1591f-127d-4ca7-87c0-af08732f1d9f of volume 5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] snapshot_file for this snap is: volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[15202b2c-151e-4805-b95f-caa5d4202d1e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:37 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f Sep 28 18:13:37 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:37 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f" returned: 0 in 0.427s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e196088-ff36-4670-a3a0-ef661659c384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41d91d2-dacd-48a6-b100-0f423d042e8d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:37 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 Sep 28 18:13:37 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:38 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384" returned: 0 in 0.600s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:38 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f Sep 28 18:13:38 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:38 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f" returned: 0 in 0.382s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:38 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f Sep 28 18:13:38 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:38 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384.2ff1591f-127d-4ca7-87c0-af08732f1d9f" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-2ff1591f-127d-4ca7-87c0-af08732f1d9f" released by "_delete_snapshot" :: held 1.824s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.325s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.128s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-12255306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c708fe-ba96-46d5-986d-6a6a66948d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968162236b3b431a88c2c00310413352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:27Z,use_quota=True,user_id='92115d7cabbe42d892430eebbc2aabf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Creating volume b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:38 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490abb08-0fb2-4d4b-b512-09a9450949d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0', 'volume_size': 1, 'source_volid': '5e196088-ff36-4670-a3a0-ef661659c384', 'source_volstatus': 'available'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:38 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 1073741824 Sep 28 18:13:38 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db2c16c-ee1d-400f-a4bf-84e88b7b66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:38 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Volume volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 (ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0): created successfully Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db2c16c-ee1d-400f-a4bf-84e88b7b66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (4a8efc35-5393-44bf-9f13-1086a1ebb854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5ac4b018-7565-49d3-9747-b63ec87a20e4 tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:13:39 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 1073741824" returned: 0 in 0.526s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:39 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 Sep 28 18:13:39 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:39 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20" returned: 0 in 0.373s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.275s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7968624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403d8e15-3111-4a05-b310-d6a67a5b8662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:29Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating volume 403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:39 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:39 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 1073741824 Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d08fca-a352-4dee-88aa-f86b25a97ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c708fe-ba96-46d5-986d-6a6a66948d20', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:39 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fe222b-0f72-4c29-a069-b0dfdd5330a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Volume volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 (b2c708fe-ba96-46d5-986d-6a6a66948d20): created successfully Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fe222b-0f72-4c29-a069-b0dfdd5330a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Flow 'volume_create_manager' (97ad39a2-c054-4f61-b468-84079d7f2417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3f96d5c1-5f82-48e6-9a75-33e1ecec8a53 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Created volume successfully. Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (1bd96b37-70c3-4a1d-ae4f-d7e209b69973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736eb1da-9a65-4e5d-8e03-cc1ef3c7fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736eb1da-9a65-4e5d-8e03-cc1ef3c7fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1974093033',display_name='tempest-VolumesGetTest-Volume-110203283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2737a0ae-e351-498e-aa5f-3024867f2c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:40Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130f142a-54d2-475c-acf4-3d1e3c76b268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130f142a-54d2-475c-acf4-3d1e3c76b268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc2ca5e-320d-4f25-947c-4dd92bc5d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc2ca5e-320d-4f25-947c-4dd92bc5d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2737a0ae-e351-498e-aa5f-3024867f2c39', 'volume_name': 'volume-2737a0ae-e351-498e-aa5f-3024867f2c39', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598d5d18-da20-42fd-90f2-cb78c40c367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598d5d18-da20-42fd-90f2-cb78c40c367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d274af5-46a4-4d1b-adad-a4b420bf2750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Volume 2737a0ae-e351-498e-aa5f-3024867f2c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2737a0ae-e351-498e-aa5f-3024867f2c39', 'volume_size': 1} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:40 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 1073741824" returned: 0 in 0.658s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:40 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 Sep 28 18:13:40 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:40 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662" returned: 0 in 0.333s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1974093033',display_name='tempest-VolumesGetTest-Volume-110203283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2737a0ae-e351-498e-aa5f-3024867f2c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:40Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Creating volume 2737a0ae-e351-498e-aa5f-3024867f2c39 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:40 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba23604-a9da-46e9-9f35-d8757bffff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403d8e15-3111-4a05-b310-d6a67a5b8662', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40adf907-6fac-4407-a9b6-cacbbf1927ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:40 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 1073741824 Sep 28 18:13:40 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume volume-403d8e15-3111-4a05-b310-d6a67a5b8662 (403d8e15-3111-4a05-b310-d6a67a5b8662): created successfully Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40adf907-6fac-4407-a9b6-cacbbf1927ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (55975448-2772-477b-873a-052f015f1cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-57fce6b7-355e-4092-a78d-650b25d5fe13 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created volume successfully. Sep 28 18:13:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:41 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 1073741824" returned: 0 in 0.586s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:41 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 Sep 28 18:13:41 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:41 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.848s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Creating offline snapshot 7ca75bcf-33ad-404e-bf9f-24cc65470091 of volume b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d274af5-46a4-4d1b-adad-a4b420bf2750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2737a0ae-e351-498e-aa5f-3024867f2c39', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d2ae6a-d751-4971-8a00-37f4cd7e328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dd9874-1879-42d2-948f-9eefa1558414]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Volume volume-2737a0ae-e351-498e-aa5f-3024867f2c39 (2737a0ae-e351-498e-aa5f-3024867f2c39): created successfully Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d2ae6a-d751-4971-8a00-37f4cd7e328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (1bd96b37-70c3-4a1d-ae4f-d7e209b69973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-06d9c01f-df78-4a40-a6f0-d5db1c91d2a7 tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:13:42 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 Sep 28 18:13:42 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:42 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20" returned: 0 in 0.463s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:42 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 1G Sep 28 18:13:42 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-2737a0ae-e351-498e-aa5f-3024867f2c39-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Lock "cinder-2737a0ae-e351-498e-aa5f-3024867f2c39-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-2737a0ae-e351-498e-aa5f-3024867f2c39" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-2737a0ae-e351-498e-aa5f-3024867f2c39" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5688193-7381-4e48-85a7-fffdb350b359]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:42 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 1G" returned: 0 in 0.575s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:42 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 Sep 28 18:13:42 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:42 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 Sep 28 18:13:42 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:43 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091" returned: 0 in 0.367s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:43 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 is being set with open permissions: ugo+rw Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:43 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 Sep 28 18:13:43 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:43 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39" returned: 0 in 0.552s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:43 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39 Sep 28 18:13:43 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:43 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091" returned: 0 in 0.301s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:43 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2737a0ae-e351-498e-aa5f-3024867f2c39" returned: 0 in 0.337s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:43 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info Sep 28 18:13:43 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-2737a0ae-e351-498e-aa5f-3024867f2c39" released by "delete_volume" :: held 0.950s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Created reservations ['7e325506-2cbc-429e-9afb-a5a086b21483', 'f235747f-de80-461a-a1f7-5971e032f3a3', '49c234fd-c415-4bd2-8c39-eda9b4755b1a', 'f1ac7264-117d-47ee-9894-bdbc3e75ebd5'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:43 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:43 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:44 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info" returned: 0 in 0.351s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:44 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info is being set with open permissions: ugo+rw Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:44 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info Sep 28 18:13:44 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:44 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.321s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48acf1eb-2af9-49c0-94ca-4d3643a14bfb tempest-VolumesGetTest-1123124467 None] Lock "cinder-2737a0ae-e351-498e-aa5f-3024867f2c39-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:44 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.info" returned: 0 in 0.311s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.717s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating offline snapshot a75aacc2-19e0-4038-bee8-b1ea0966bc65 of volume 403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3d9bacd7-2607-441a-9233-5de55ea0beb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Create snapshot completed successfully Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f50e273-2801-457d-9bf2-465f45296f1b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:44 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 Sep 28 18:13:44 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:44 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:44 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 1G Sep 28 18:13:44 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Lock "cinder-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c94958-eff4-4fca-b7d7-e68df54c843e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:45 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 Sep 28 18:13:45 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:45 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 1G" returned: 0 in 0.676s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-403d8e15-3111-4a05-b310-d6a67a5b8662 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:45 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-403d8e15-3111-4a05-b310-d6a67a5b8662 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 Sep 28 18:13:45 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:45 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" returned: 0 in 0.608s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:45 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0 Sep 28 18:13:45 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "cinder-7ca75bcf-33ad-404e-bf9f-24cc65470091-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-403d8e15-3111-4a05-b310-d6a67a5b8662 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65" returned: 0 in 0.456s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 is being set with open permissions: ugo+rw Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-7ca75bcf-33ad-404e-bf9f-24cc65470091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:46 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "cinder-quobyte-b2c708fe-ba96-46d5-986d-6a6a66948d20" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:46 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-quobyte-b2c708fe-ba96-46d5-986d-6a6a66948d20" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "cinder-quobyte-7ca75bcf-33ad-404e-bf9f-24cc65470091" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-quobyte-7ca75bcf-33ad-404e-bf9f-24cc65470091" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Deleting offline snapshot 7ca75bcf-33ad-404e-bf9f-24cc65470091 of volume b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] snapshot_file for this snap is: volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba2e6ae-ecf6-4a72-8b9d-3288a33681e7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0" released by "delete_volume" :: held 1.023s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:46 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 Sep 28 18:13:46 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Created reservations ['ddc6fcf6-6e6f-4fa4-a296-5ffac04f07ca', 'f4e2ba52-891b-4b01-a66c-d0b16da7f91e', '194e2570-df18-4102-a114-c6c985b2248c', 'e263703e-2161-4b1e-ac44-97765a9ad455'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:46 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:46 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info Sep 28 18:13:46 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091" returned: 0 in 0.493s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c708fe-ba96-46d5-986d-6a6a66948d20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29ec9a-65ed-4666-8bb5-0beb3c397989]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b9b321d5-a8a8-4e74-ac1f-a0fb7a5ae43a tempest-VolumesGetTest-1123124467 None] Lock "cinder-ad9c8fc9-47b1-4d06-8cf7-3f5166cfffe0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:46 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info" returned: 0 in 0.398s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:46 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info is being set with open permissions: ugo+rw Sep 28 18:13:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:46 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 Sep 28 18:13:46 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:46 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info Sep 28 18:13:46 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:47 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20" returned: 0 in 0.521s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:47 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.info" returned: 0 in 0.367s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:47 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 Sep 28 18:13:47 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.911s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9a4492ba-1f55-4157-b12d-473680a295eb tempest-CreateVolumesFromSnapshotTest-1386143629 None] Create snapshot completed successfully Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-5e196088-ff36-4670-a3a0-ef661659c384-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-5e196088-ff36-4670-a3a0-ef661659c384-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-5e196088-ff36-4670-a3a0-ef661659c384" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-5e196088-ff36-4670-a3a0-ef661659c384" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c463679-7120-41f9-a1ec-17ddbee80d9b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:47 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091" returned: 0 in 0.512s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:47 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091 Sep 28 18:13:47 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:47 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 Sep 28 18:13:47 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20.7ca75bcf-33ad-404e-bf9f-24cc65470091" returned: 0 in 0.389s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:48 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384" returned: 0 in 0.496s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-quobyte-7ca75bcf-33ad-404e-bf9f-24cc65470091" released by "_delete_snapshot" :: held 2.089s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-quobyte-b2c708fe-ba96-46d5-986d-6a6a66948d20" released by "delete_snapshot" :: held 2.127s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:48 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384 Sep 28 18:13:48 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Created reservations ['6e0b99d7-e876-415b-9dc8-e2fa974a2797', '8fa77346-98e3-4cd9-a3b9-50d7b5f31e30', '33d4c17c-a301-487c-8fcb-50141408adb8', '1fc7a451-bd0d-48fa-8912-53ad1c289770'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Delete snapshot completed successfully. Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-96146b47-21cc-454a-9625-c104c15efec3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-7ca75bcf-33ad-404e-bf9f-24cc65470091-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:48 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5e196088-ff36-4670-a3a0-ef661659c384" returned: 0 in 0.362s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-5e196088-ff36-4670-a3a0-ef661659c384" released by "delete_volume" :: held 0.944s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Created reservations ['49a4dd23-8eef-48b9-aaa5-c9f8deba8e64', '1d13511f-e934-4bdd-9f3e-552c8ad70c0c', '79719c28-75f2-475c-abf7-87abd72124e0', '5bf6fbcb-0797-4351-9fee-47c209fedd17'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (b38d82ec-2126-449e-9886-46ab89d7ef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6af189-c0a3-4d8f-92e2-ee42f40cf6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6af189-c0a3-4d8f-92e2-ee42f40cf6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701156541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edba2e1f-13c8-454d-83a9-173abd913a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:49Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f1dc39-c30c-4e28-be22-279c99805c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f1dc39-c30c-4e28-be22-279c99805c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce45b54a-880e-4637-819e-11972cc64d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce45b54a-880e-4637-819e-11972cc64d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edba2e1f-13c8-454d-83a9-173abd913a87', 'volume_name': 'volume-edba2e1f-13c8-454d-83a9-173abd913a87', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9124b0-c31f-4eb2-a56f-b88e33166c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9124b0-c31f-4eb2-a56f-b88e33166c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ba9c14-7260-4782-97b9-5a62c011dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume edba2e1f-13c8-454d-83a9-173abd913a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edba2e1f-13c8-454d-83a9-173abd913a87', 'volume_size': 1} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701156541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edba2e1f-13c8-454d-83a9-173abd913a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:49Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating volume edba2e1f-13c8-454d-83a9-173abd913a87 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:48 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 1073741824 Sep 28 18:13:48 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:49 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (e0d30f7a-4517-44e2-82f8-f4c133a2d77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff430382-8e40-46c7-b486-c67cb52fe92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff430382-8e40-46c7-b486-c67cb52fe92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249722647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5202f01e-c683-4d62-be6d-086fd030a4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:49Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2b0f5e-bdd7-4787-9b62-0d8c8544bb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2b0f5e-bdd7-4787-9b62-0d8c8544bb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b318d7e-2f16-4caf-9f7a-67ed2d029915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b318d7e-2f16-4caf-9f7a-67ed2d029915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5202f01e-c683-4d62-be6d-086fd030a4b5', 'volume_name': 'volume-5202f01e-c683-4d62-be6d-086fd030a4b5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8944600c-2f7c-4bc7-ae0f-7781b78d1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8944600c-2f7c-4bc7-ae0f-7781b78d1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adced60-06e8-46c9-aa41-233de14ec0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume 5202f01e-c683-4d62-be6d-086fd030a4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5202f01e-c683-4d62-be6d-086fd030a4b5', 'volume_size': 1} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "cinder-b2c708fe-ba96-46d5-986d-6a6a66948d20-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:49 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-b2c708fe-ba96-46d5-986d-6a6a66948d20-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.539s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:49 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5b6f5296-01d0-4a55-a4be-76aaa47cb9c8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-5e196088-ff36-4670-a3a0-ef661659c384-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "cinder-quobyte-b2c708fe-ba96-46d5-986d-6a6a66948d20" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-quobyte-b2c708fe-ba96-46d5-986d-6a6a66948d20" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:49 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 1073741824" returned: 0 in 0.821s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4596636-bbc8-4bfb-bebd-52de02cb29b6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 Sep 28 18:13:49 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 Sep 28 18:13:49 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (2fb28153-aad9-4976-82fc-156b1b715253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dc85bc-9ab5-475d-80c6-b9aebbf5b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dc85bc-9ab5-475d-80c6-b9aebbf5b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055777371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781f8c59-5dcb-4738-ac8f-75b2307f1760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:50Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c40d1d1-b563-4b11-9082-d12a4fb767a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c40d1d1-b563-4b11-9082-d12a4fb767a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f39ea57-f3a2-4888-99e3-db1dcc602794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f39ea57-f3a2-4888-99e3-db1dcc602794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781f8c59-5dcb-4738-ac8f-75b2307f1760', 'volume_name': 'volume-781f8c59-5dcb-4738-ac8f-75b2307f1760', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3d2cee-109b-477b-8c94-54105c622e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3d2cee-109b-477b-8c94-54105c622e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb8764a-142b-4a9f-be79-a043d578e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume 781f8c59-5dcb-4738-ac8f-75b2307f1760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781f8c59-5dcb-4738-ac8f-75b2307f1760', 'volume_size': 1} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:50 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87" returned: 0 in 0.586s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1249722647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5202f01e-c683-4d62-be6d-086fd030a4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:49Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating volume 5202f01e-c683-4d62-be6d-086fd030a4b5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:50 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:50 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ba9c14-7260-4782-97b9-5a62c011dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edba2e1f-13c8-454d-83a9-173abd913a87', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 1073741824 Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906fbba2-3eed-4ddb-bac1-fd5317a95076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20" returned: 0 in 0.751s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:50 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume volume-edba2e1f-13c8-454d-83a9-173abd913a87 (edba2e1f-13c8-454d-83a9-173abd913a87): created successfully Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906fbba2-3eed-4ddb-bac1-fd5317a95076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20 Sep 28 18:13:50 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (b38d82ec-2126-449e-9886-46ab89d7ef05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b2a7bc26-3ab7-4112-ae9a-e369a1fbf6a6 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created volume successfully. Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (37c59ab0-0200-4cbe-a2a2-ac8402a0e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef65f0a-1967-49de-b45e-4cac2e27c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef65f0a-1967-49de-b45e-4cac2e27c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1270275306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d406fa08-5da0-416a-9870-ec2738b65faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:51Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859a55d0-570e-4693-9970-277b929d1d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859a55d0-570e-4693-9970-277b929d1d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f3ae0a-73f8-46ec-94cc-1c5838fdf33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f3ae0a-73f8-46ec-94cc-1c5838fdf33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd406fa08-5da0-416a-9870-ec2738b65faa', 'volume_name': 'volume-d406fa08-5da0-416a-9870-ec2738b65faa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d8c877-7556-430e-bba4-7aa6a7fed89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d8c877-7556-430e-bba4-7aa6a7fed89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309deaf4-7a55-426a-af65-da25e8d2ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume d406fa08-5da0-416a-9870-ec2738b65faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d406fa08-5da0-416a-9870-ec2738b65faa', 'volume_size': 1} Sep 28 18:13:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:51 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b2c708fe-ba96-46d5-986d-6a6a66948d20" returned: 0 in 0.571s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-quobyte-b2c708fe-ba96-46d5-986d-6a6a66948d20" released by "delete_volume" :: held 1.428s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Created reservations ['f14a6a00-849b-4e5d-9c67-e20e7810bd2e', '1ab9775e-6633-4034-9414-51116bc6aab8', '01a402a7-123d-4d6b-8c13-649013330e19', '48bf4bbe-ae29-42aa-982a-dcb23396cc00'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (5d8a3a59-e5d2-4289-bbed-1dc378ceb6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964ef9fd-960b-487a-96db-2d077e8b8f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964ef9fd-960b-487a-96db-2d077e8b8f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695211167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecdeab1-5447-4538-8dce-0024b68a9208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:51Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ce5d38-bc05-4861-946e-fcc54ef9bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ce5d38-bc05-4861-946e-fcc54ef9bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52475f7-2885-4f55-a829-01d59df859cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52475f7-2885-4f55-a829-01d59df859cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ecdeab1-5447-4538-8dce-0024b68a9208', 'volume_name': 'volume-2ecdeab1-5447-4538-8dce-0024b68a9208', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2bec8-9c5c-494e-ae8b-e74d1d633457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d2bec8-9c5c-494e-ae8b-e74d1d633457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2883f4-4156-4264-8543-746d20235ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume 2ecdeab1-5447-4538-8dce-0024b68a9208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ecdeab1-5447-4538-8dce-0024b68a9208', 'volume_size': 1} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 1073741824" returned: 0 in 1.043s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:51 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 Sep 28 18:13:51 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:51 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:51 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:51 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5" returned: 0 in 0.355s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055777371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781f8c59-5dcb-4738-ac8f-75b2307f1760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:50Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating volume 781f8c59-5dcb-4738-ac8f-75b2307f1760 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:51 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:51 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:51 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 1073741824 Sep 28 18:13:51 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (bdee71d9-447c-48d2-92b0-dae245d35512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16574b62-d3ec-4c4c-ac4d-3dc41bcfef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.393s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adced60-06e8-46c9-aa41-233de14ec0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5202f01e-c683-4d62-be6d-086fd030a4b5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f57869-56d7-4cc3-b4e4-7a1de2fd9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Deleted volume successfully. Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16574b62-d3ec-4c4c-ac4d-3dc41bcfef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1017009570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e3977e-34f8-435c-8853-029e868746ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:52Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be71b063-edc1-4012-b48d-afc5f6d73921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be71b063-edc1-4012-b48d-afc5f6d73921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25660d3-6147-45ad-899e-9bb877ba379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:51 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:13:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume volume-5202f01e-c683-4d62-be6d-086fd030a4b5 (5202f01e-c683-4d62-be6d-086fd030a4b5): created successfully Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f57869-56d7-4cc3-b4e4-7a1de2fd9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (e0d30f7a-4517-44e2-82f8-f4c133a2d77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e454229a-6b6b-4af4-9e1c-5a2afca2b2b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1745768800 None] Lock "cinder-b2c708fe-ba96-46d5-986d-6a6a66948d20-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9488eb53-bcba-4abc-8ec5-fd1b144355a1 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created volume successfully. Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25660d3-6147-45ad-899e-9bb877ba379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03e3977e-34f8-435c-8853-029e868746ce', 'volume_name': 'volume-03e3977e-34f8-435c-8853-029e868746ce', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93ae114-7f1f-4ecc-9895-5e5a3512d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93ae114-7f1f-4ecc-9895-5e5a3512d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fe59c1-7168-40bf-9619-17ba2285e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Volume 03e3977e-34f8-435c-8853-029e868746ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03e3977e-34f8-435c-8853-029e868746ce', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Trying to clone 03e3977e-34f8-435c-8853-029e868746ce from image fadc8935-e87d-4b36-9885-050bf1046672 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:13:52 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 1073741824" returned: 0 in 0.693s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:52 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 Sep 28 18:13:52 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:13:52 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[86665b6a-acab-4383-9ee7-3e7209922ab8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760" returned: 0 in 0.396s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.123s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1270275306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d406fa08-5da0-416a-9870-ec2738b65faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:51Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating volume d406fa08-5da0-416a-9870-ec2738b65faa {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:53 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD Sep 28 18:13:53 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb8764a-142b-4a9f-be79-a043d578e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781f8c59-5dcb-4738-ac8f-75b2307f1760', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:53 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa 1073741824 Sep 28 18:13:53 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f1c2ec-8627-4539-9ce4-1eb94a88e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 (781f8c59-5dcb-4738-ac8f-75b2307f1760): created successfully Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f1c2ec-8627-4539-9ce4-1eb94a88e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (2fb28153-aad9-4976-82fc-156b1b715253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e3dacbe8-40ae-4e9b-a149-bea8065bcc95 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created volume successfully. Sep 28 18:13:53 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 is fetched for user eba6bd5731e647f38a60ada447fa3772. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b397893c-6964-41cf-b7c8-ecf88e398e79]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD Sep 28 18:13:53 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa 1073741824" returned: 0 in 0.678s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa Sep 28 18:13:53 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:54 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa" returned: 0 in 0.344s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.698s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1695211167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ecdeab1-5447-4538-8dce-0024b68a9208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bcafded6554aa7b5af3e8ab971cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:51Z,use_quota=True,user_id='74a34afb7385476e9f69a13dfaf90e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Creating volume 2ecdeab1-5447-4538-8dce-0024b68a9208 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:54 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:54 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 1073741824 Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309deaf4-7a55-426a-af65-da25e8d2ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d406fa08-5da0-416a-9870-ec2738b65faa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:54 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a285f03d-bb96-4053-9852-d72f3594fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume volume-d406fa08-5da0-416a-9870-ec2738b65faa (d406fa08-5da0-416a-9870-ec2738b65faa): created successfully Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a285f03d-bb96-4053-9852-d72f3594fadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (37c59ab0-0200-4cbe-a2a2-ac8402a0e926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6c4df7de-14e4-41b9-a662-be4756a38460 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created volume successfully. Sep 28 18:13:54 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 1073741824" returned: 0 in 0.611s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:54 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 Sep 28 18:13:54 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:55 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208" returned: 0 in 0.368s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1017009570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e3977e-34f8-435c-8853-029e868746ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:52Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Creating volume 03e3977e-34f8-435c-8853-029e868746ce {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:55 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:55 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce 1073741824 Sep 28 18:13:55 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2883f4-4156-4264-8543-746d20235ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ecdeab1-5447-4538-8dce-0024b68a9208', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fa5d7d-bfc0-4ad8-abc3-0cfb08e7af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Volume volume-2ecdeab1-5447-4538-8dce-0024b68a9208 (2ecdeab1-5447-4538-8dce-0024b68a9208): created successfully Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fa5d7d-bfc0-4ad8-abc3-0cfb08e7af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Flow 'volume_create_manager' (5d8a3a59-e5d2-4289-bbed-1dc378ceb6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-53a18ba9-a653-42b5-aafd-27adc0a2254e tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created volume successfully. Sep 28 18:13:55 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce 1073741824" returned: 0 in 0.581s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:55 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce Sep 28 18:13:55 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-2ecdeab1-5447-4538-8dce-0024b68a9208-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-2ecdeab1-5447-4538-8dce-0024b68a9208-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-2ecdeab1-5447-4538-8dce-0024b68a9208" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-2ecdeab1-5447-4538-8dce-0024b68a9208" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[424c36e9-f28d-42db-8d89-3abe4082ae6c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:56 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Attempting download of fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume 03e3977e-34f8-435c-8853-029e868746ce. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ead0ee-1161-4d8b-aa33-0451d17bac18]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:56 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:56 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:56 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1 Sep 28 18:13:56 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:56 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208" returned: 0 in 0.559s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:56 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208 Sep 28 18:13:56 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:56 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1" returned: 0 in 0.441s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:56 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1 Sep 28 18:13:56 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:57 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-2ecdeab1-5447-4538-8dce-0024b68a9208" returned: 0 in 0.326s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-2ecdeab1-5447-4538-8dce-0024b68a9208" released by "delete_volume" :: held 0.985s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:57 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['f8ec893a-af72-4281-9b0f-2448eb542bbb', '0a57ce07-d92e-4f9e-b2ed-8abfce2ae654', '992f5d73-bfef-48ee-b520-eba094e8a3da', 'b7b9ff73-f116-445e-a3d1-7bbf4530c85e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1" returned: 1 in 0.434s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_dyyjgiy1' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e0a389-33b7-493a-bb58-c9dd8db1dc6c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:57 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:57 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:57 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD Sep 28 18:13:57 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:57 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] fadc8935-e87d-4b36-9885-050bf1046672 was qcow2, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:57 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleted volume successfully. Sep 28 18:13:57 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce Sep 28 18:13:57 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71e2f33a-383c-4b41-934a-55ca2ee16581 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-2ecdeab1-5447-4538-8dce-0024b68a9208-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-d406fa08-5da0-416a-9870-ec2738b65faa-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-d406fa08-5da0-416a-9870-ec2738b65faa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-d406fa08-5da0-416a-9870-ec2738b65faa" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-d406fa08-5da0-416a-9870-ec2738b65faa" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e14cee-dc11-448f-9e24-110617f8699e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:58 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa Sep 28 18:13:58 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:58 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa" returned: 0 in 0.484s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:58 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa Sep 28 18:13:58 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:59 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d406fa08-5da0-416a-9870-ec2738b65faa" returned: 0 in 0.320s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-d406fa08-5da0-416a-9870-ec2738b65faa" released by "delete_volume" :: held 0.880s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['1160892c-19b7-4a6d-a6c1-6e03f6c78a70', '01eef39d-5296-40bd-b7f1-0e8af16324ed', '22e216f0-e654-4570-acad-77903b26fc28', '750f045c-1766-4442-8b23-42316da486f1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:59 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:13:59 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-781f8c59-5dcb-4738-ac8f-75b2307f1760-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-781f8c59-5dcb-4738-ac8f-75b2307f1760-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-781f8c59-5dcb-4738-ac8f-75b2307f1760" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-781f8c59-5dcb-4738-ac8f-75b2307f1760" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3244c3bf-f7c2-4e8d-afe3-5e3fd119709a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:59 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleted volume successfully. Sep 28 18:13:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-71767946-fd50-48ab-a6f5-22f694e21cdf tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-d406fa08-5da0-416a-9870-ec2738b65faa-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:59 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 Sep 28 18:13:59 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:00 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760" returned: 0 in 0.485s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:00 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760 Sep 28 18:14:00 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:00 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce" returned: 0 in 2.608s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_t3kevrmudevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:14:00 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Converted 112.00 MB image at 42.91 MB/s Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:00 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce 1G Sep 28 18:14:00 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:00 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-781f8c59-5dcb-4738-ac8f-75b2307f1760" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-781f8c59-5dcb-4738-ac8f-75b2307f1760" released by "delete_volume" :: held 0.853s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['21845ac4-d8d4-4546-a5aa-66cec5f2d823', 'df0bab5a-abd0-44dc-81a7-bd78b76e0f37', 'd7a3bd2c-5498-4e34-8bae-a7d0e137db99', 'a3dca287-32c8-40f9-a1c3-be8ddb2a0a92'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-5202f01e-c683-4d62-be6d-086fd030a4b5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:00 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:00 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-5202f01e-c683-4d62-be6d-086fd030a4b5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:00 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce 1G" returned: 0 in 0.585s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Downloaded image fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume 03e3977e-34f8-435c-8853-029e868746ce successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 for user eba6bd5731e647f38a60ada447fa3772 is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Marking volume 03e3977e-34f8-435c-8853-029e868746ce as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Copying metadata from image fadc8935-e87d-4b36-9885-050bf1046672 to 03e3977e-34f8-435c-8853-029e868746ce. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Creating volume glance metadata for volume 03e3977e-34f8-435c-8853-029e868746ce backed by image fadc8935-e87d-4b36-9885-050bf1046672 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:14:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-5202f01e-c683-4d62-be6d-086fd030a4b5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-5202f01e-c683-4d62-be6d-086fd030a4b5" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[facc595b-9ac2-4dc1-abf0-7dd2a7f3237c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Flow 'volume_create_manager' (ace88d52-38b8-445e-9340-d6222afe78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9d55e2-b283-4762-aa3f-721f8d1ec1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:01 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9d55e2-b283-4762-aa3f-721f8d1ec1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118826553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd7b7ed-cb55-403d-b4e0-3d48c1407a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954af635fdad471eac315441dade9d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:01Z,use_quota=True,user_id='36a58607b51346a4b64546512433061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db5cb0c-18d3-4386-8616-0424e63f69fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:01 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 Sep 28 18:14:01 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db5cb0c-18d3-4386-8616-0424e63f69fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630f30f4-0e7c-46c2-8f51-2389d00aeb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630f30f4-0e7c-46c2-8f51-2389d00aeb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd7b7ed-cb55-403d-b4e0-3d48c1407a89', 'volume_name': 'volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fe183b-4728-4486-b0a0-e02fbb8d6eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81fe183b-4728-4486-b0a0-e02fbb8d6eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf8567d-fad1-4ed3-9b7c-99eddf5ca5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:01 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Volume 1cd7b7ed-cb55-403d-b4e0-3d48c1407a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89', 'volume_size': 1} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118826553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd7b7ed-cb55-403d-b4e0-3d48c1407a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954af635fdad471eac315441dade9d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:01Z,use_quota=True,user_id='36a58607b51346a4b64546512433061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Creating volume 1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:01 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:01 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 1073741824 Sep 28 18:14:01 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleted volume successfully. Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fe59c1-7168-40bf-9619-17ba2285e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e3977e-34f8-435c-8853-029e868746ce', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50cd66b-49bc-4066-b18a-927bff2aaf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:01 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Volume volume-03e3977e-34f8-435c-8853-029e868746ce (03e3977e-34f8-435c-8853-029e868746ce): created successfully Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a50cd66b-49bc-4066-b18a-927bff2aaf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (bdee71d9-447c-48d2-92b0-dae245d35512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2240ca22-f2c6-4afc-83af-50cdd85da447 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-781f8c59-5dcb-4738-ac8f-75b2307f1760-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d274ca4f-94df-4ff5-885b-78d866eb90c8 tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:14:01 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5" returned: 0 in 0.528s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:01 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5 Sep 28 18:14:01 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:01 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 1073741824" returned: 0 in 0.607s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:01 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5202f01e-c683-4d62-be6d-086fd030a4b5" returned: 0 in 0.367s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:01 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 Sep 28 18:14:02 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-5202f01e-c683-4d62-be6d-086fd030a4b5" released by "delete_volume" :: held 0.994s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['c8445f5c-5f7e-4904-976f-cd7d64c6178c', '0b1c961f-c584-4cbf-b8f0-330f7c7e84fa', '8fe49fda-8998-4834-81f5-9eaa32ebd229', 'd6118994-bdeb-46f8-8f52-718edec9eeaa'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:02 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:02 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:02 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89" returned: 0 in 0.467s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf8567d-fad1-4ed3-9b7c-99eddf5ca5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd73e68-48c4-4f52-b595-9225aa6990a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:02 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Volume volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 (1cd7b7ed-cb55-403d-b4e0-3d48c1407a89): created successfully Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd73e68-48c4-4f52-b595-9225aa6990a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Flow 'volume_create_manager' (ace88d52-38b8-445e-9340-d6222afe78e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0a5a4e9d-d1a3-4989-aaf5-397ad4da2dbb tempest-VolumesListAdminTestJSON-858450592 None] Created volume successfully. Sep 28 18:14:02 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.453s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleted volume successfully. Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1846de7b-129b-4d87-9fe7-f153eccf2425 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-5202f01e-c683-4d62-be6d-086fd030a4b5-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (c6a7cba8-ab60-4bfc-9d81-ba26e27857a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff786fd1-989d-4ab2-be3b-749fe8d250c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff786fd1-989d-4ab2-be3b-749fe8d250c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-740814889',display_name='tempest-VolumesGetTest-Volume-772173244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82745134-34cf-4ce1-ab11-cde08a1cd5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:03Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783c505b-fc35-4fa8-a54d-3e312b7bee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783c505b-fc35-4fa8-a54d-3e312b7bee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a91e3de-feec-4ef1-8391-6cea75cbc427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a91e3de-feec-4ef1-8391-6cea75cbc427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82745134-34cf-4ce1-ab11-cde08a1cd5d4', 'volume_name': 'volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292b6066-199c-4d99-a97a-d4a2ff1900d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292b6066-199c-4d99-a97a-d4a2ff1900d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2f619f-2352-4bbd-b3cd-539207dedacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:02 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Volume 82745134-34cf-4ce1-ab11-cde08a1cd5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4', 'volume_size': 1} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-740814889',display_name='tempest-VolumesGetTest-Volume-772173244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82745134-34cf-4ce1-ab11-cde08a1cd5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a0d54a28e84452875c76604f3de386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:03Z,use_quota=True,user_id='eba6bd5731e647f38a60ada447fa3772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Creating volume 82745134-34cf-4ce1-ab11-cde08a1cd5d4 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:02 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:02 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 1073741824 Sep 28 18:14:02 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-edba2e1f-13c8-454d-83a9-173abd913a87-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-edba2e1f-13c8-454d-83a9-173abd913a87-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-edba2e1f-13c8-454d-83a9-173abd913a87" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-edba2e1f-13c8-454d-83a9-173abd913a87" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dd72a9-e2ab-48e4-838c-d397d9f644e4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:03 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 Sep 28 18:14:03 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:03 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 1073741824" returned: 0 in 0.568s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:03 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 Sep 28 18:14:03 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:03 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87" returned: 0 in 0.534s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:03 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87 Sep 28 18:14:03 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:03 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Flow 'volume_create_manager' (fd21bfa9-9896-42e7-bce2-4952808e6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf31686-a38a-41db-a9ef-a403e818fa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4" returned: 0 in 0.405s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf31686-a38a-41db-a9ef-a403e818fa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1453595461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fda2c5-7f7c-4f62-83fb-fa5c8b082761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954af635fdad471eac315441dade9d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:04Z,use_quota=True,user_id='36a58607b51346a4b64546512433061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4a5809-ceb2-436c-9813-12257b722089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4a5809-ceb2-436c-9813-12257b722089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdca3a7-d4c0-4b60-ae53-5871488329e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdca3a7-d4c0-4b60-ae53-5871488329e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fda2c5-7f7c-4f62-83fb-fa5c8b082761', 'volume_name': 'volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e802bb-d0f1-4438-90e2-38ee57245baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e802bb-d0f1-4438-90e2-38ee57245baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6567f6-50c9-4d45-acf8-992ed87fb5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:04 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Volume b6fda2c5-7f7c-4f62-83fb-fa5c8b082761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761', 'volume_size': 1} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1453595461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fda2c5-7f7c-4f62-83fb-fa5c8b082761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954af635fdad471eac315441dade9d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:04Z,use_quota=True,user_id='36a58607b51346a4b64546512433061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Creating volume b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:04 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2f619f-2352-4bbd-b3cd-539207dedacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:04 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 1073741824 Sep 28 18:14:04 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9f009c-9af5-4b59-b78f-3411ec204237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:04 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Volume volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 (82745134-34cf-4ce1-ab11-cde08a1cd5d4): created successfully Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9f009c-9af5-4b59-b78f-3411ec204237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Flow 'volume_create_manager' (c6a7cba8-ab60-4bfc-9d81-ba26e27857a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-30c378ab-5fb8-4633-8a59-24e922350d88 tempest-VolumesGetTest-1123124467 None] Created volume successfully. Sep 28 18:14:04 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-edba2e1f-13c8-454d-83a9-173abd913a87" returned: 0 in 0.294s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-edba2e1f-13c8-454d-83a9-173abd913a87" released by "delete_volume" :: held 0.885s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['617f2349-f0c1-4f3d-b5b7-c3bd566345b0', 'b5335252-68ff-4b95-b832-d7aece134eb6', '8c2878c5-3527-42f7-b8ef-bb596f3dbce9', '1e17f756-ddaa-4a41-bce3-4634b4afc27d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:04 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:04 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-a75aacc2-19e0-4038-bee8-b1ea0966bc65-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-a75aacc2-19e0-4038-bee8-b1ea0966bc65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-403d8e15-3111-4a05-b310-d6a67a5b8662" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-403d8e15-3111-4a05-b310-d6a67a5b8662" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-a75aacc2-19e0-4038-bee8-b1ea0966bc65" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-a75aacc2-19e0-4038-bee8-b1ea0966bc65" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleting offline snapshot a75aacc2-19e0-4038-bee8-b1ea0966bc65 of volume 403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] snapshot_file for this snap is: volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d93634-1d8d-4b37-a02c-d64d3311400a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:04 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 1073741824" returned: 0 in 0.624s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:04 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 Sep 28 18:14:04 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:04 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 Sep 28 18:14:04 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:04 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.366s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleted volume successfully. Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7f3fae7-3bb2-499f-8f22-d7d4572a8af4 tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-edba2e1f-13c8-454d-83a9-173abd913a87-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:04 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6567f6-50c9-4d45-acf8-992ed87fb5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8644021-17e7-4194-8177-94e2e3843e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Volume volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 (b6fda2c5-7f7c-4f62-83fb-fa5c8b082761): created successfully Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8644021-17e7-4194-8177-94e2e3843e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Flow 'volume_create_manager' (fd21bfa9-9896-42e7-bce2-4952808e6af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:05 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8a84f0d3-bc27-4f86-950c-6e85a05da7a6 tempest-VolumesListAdminTestJSON-858450592 None] Created volume successfully. Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65" returned: 0 in 0.533s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-403d8e15-3111-4a05-b310-d6a67a5b8662(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc16b5c-3877-48d8-a4d2-bd56135654f3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-82745134-34cf-4ce1-ab11-cde08a1cd5d4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-82745134-34cf-4ce1-ab11-cde08a1cd5d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-82745134-34cf-4ce1-ab11-cde08a1cd5d4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-82745134-34cf-4ce1-ab11-cde08a1cd5d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a2b22-6ab9-48f2-8f59-446607b71f61]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:05 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 Sep 28 18:14:05 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:05 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 Sep 28 18:14:05 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:05 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:05 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 Sep 28 18:14:05 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:05 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4" returned: 0 in 0.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:05 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4 Sep 28 18:14:05 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:05 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-82745134-34cf-4ce1-ab11-cde08a1cd5d4" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-82745134-34cf-4ce1-ab11-cde08a1cd5d4" released by "delete_volume" :: held 0.782s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:06 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65" returned: 0 in 0.464s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Created reservations ['733c8937-6695-4348-bcb1-66822774835d', '21af7d67-aced-43f8-8437-10f347cdf4c4', '10b2dbc9-5275-47c0-9796-6596ac8b5c7f', '198e51ef-ce2a-486d-b261-683af988c25b'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:06 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65 Sep 28 18:14:06 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:06 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:06 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:06 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662.a75aacc2-19e0-4038-bee8-b1ea0966bc65" returned: 0 in 0.329s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-a75aacc2-19e0-4038-bee8-b1ea0966bc65" released by "_delete_snapshot" :: held 1.989s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-403d8e15-3111-4a05-b310-d6a67a5b8662" released by "delete_snapshot" :: held 2.022s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-03e3977e-34f8-435c-8853-029e868746ce-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Lock "cinder-03e3977e-34f8-435c-8853-029e868746ce-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:06 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.440s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Acquiring lock "cinder-quobyte-03e3977e-34f8-435c-8853-029e868746ce" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4be0ba8c-0b32-4df1-8150-fab3794d07a8 tempest-VolumesGetTest-1123124467 None] Lock "cinder-82745134-34cf-4ce1-ab11-cde08a1cd5d4-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-03e3977e-34f8-435c-8853-029e868746ce" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['ccdbe77a-f258-4d02-ae04-1cc5fa4b4217', '527d91e5-3ab7-4513-a38c-46723a8b1363', '2743c621-db7e-4bad-b7ac-0ba066c26923', '0540b322-e9fe-44bc-904a-59af44eb8a11'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad24947d-d190-401c-bb73-762cab72f57f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Flow 'volume_create_manager' (cab4919f-29e0-438d-8d09-e2261c35bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4a384e-f337-4b6a-92da-7d72006849d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4a384e-f337-4b6a-92da-7d72006849d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1092398991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b387ad-e7fd-4de0-8aae-e0af47e0ef46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954af635fdad471eac315441dade9d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:07Z,use_quota=True,user_id='36a58607b51346a4b64546512433061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f30d13d-eb21-4999-b4c3-33b5ea7e47d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:06 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce Sep 28 18:14:06 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f30d13d-eb21-4999-b4c3-33b5ea7e47d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ecc8d0-a242-42d0-a3bf-d4344f493568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ecc8d0-a242-42d0-a3bf-d4344f493568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b387ad-e7fd-4de0-8aae-e0af47e0ef46', 'volume_name': 'volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2785aef-2dc5-4da2-9210-f946c9264dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2785aef-2dc5-4da2-9210-f946c9264dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b34ffe-8064-41a7-b02a-c29e9f548f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:06 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Volume 75b387ad-e7fd-4de0-8aae-e0af47e0ef46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46', 'volume_size': 1} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1092398991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b387ad-e7fd-4de0-8aae-e0af47e0ef46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954af635fdad471eac315441dade9d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:07Z,use_quota=True,user_id='36a58607b51346a4b64546512433061e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Creating volume 75b387ad-e7fd-4de0-8aae-e0af47e0ef46 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:06 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Delete snapshot completed successfully. Sep 28 18:14:06 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 1073741824 Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c3eae1c3-d7ff-4de4-8a4c-14fbe88ca3ab tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-a75aacc2-19e0-4038-bee8-b1ea0966bc65-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:06 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:07 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce" returned: 0 in 0.504s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:07 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce Sep 28 18:14:07 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:07 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 1073741824" returned: 0 in 0.558s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:07 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 Sep 28 18:14:07 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:07 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03e3977e-34f8-435c-8853-029e868746ce" returned: 0 in 0.391s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Lock "cinder-quobyte-03e3977e-34f8-435c-8853-029e868746ce" released by "delete_volume" :: held 0.968s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-403d8e15-3111-4a05-b310-d6a67a5b8662-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-403d8e15-3111-4a05-b310-d6a67a5b8662-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Created reservations ['08eb4fdc-ed9a-4ef6-91b0-717308d39b69', '784a6002-52fd-4da3-a55c-9175530b7c91', 'cf880723-bbdd-4509-995c-cfde0a378be6', '27505c25-85c5-41ef-9f5b-7d65335dfe11'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "cinder-quobyte-403d8e15-3111-4a05-b310-d6a67a5b8662" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-403d8e15-3111-4a05-b310-d6a67a5b8662" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:07 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46" returned: 0 in 0.376s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5b3674-2f9a-4a43-b37d-0eccbec2bf87]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b34ffe-8064-41a7-b02a-c29e9f548f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0b5811-5910-4a1f-8b8b-aa7a50a836de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Volume volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 (75b387ad-e7fd-4de0-8aae-e0af47e0ef46): created successfully Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0b5811-5910-4a1f-8b8b-aa7a50a836de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Flow 'volume_create_manager' (cab4919f-29e0-438d-8d09-e2261c35bc22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ddf36a99-5ad8-441f-8b65-992e5784fde1 tempest-VolumesListAdminTestJSON-858450592 None] Created volume successfully. Sep 28 18:14:08 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:08 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:08 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 Sep 28 18:14:08 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:08 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.342s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Deleted volume successfully. Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=147,cinder:UPDATE=203,cinder:INSERT=64,cinder:DELETE=14 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c5120ff5-59aa-4ff9-b4ad-a54b08671d70 tempest-VolumesGetTest-1123124467 None] Lock "cinder-03e3977e-34f8-435c-8853-029e868746ce-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:08 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662" returned: 0 in 0.500s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:08 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662 Sep 28 18:14:08 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:08 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-403d8e15-3111-4a05-b310-d6a67a5b8662" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-quobyte-403d8e15-3111-4a05-b310-d6a67a5b8662" released by "delete_volume" :: held 0.895s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=189,cinder:INSERT=50,cinder:DELETE=22,cinder:SELECT=152 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Created reservations ['049d413f-b9b5-461f-a1ba-78e5da8ec385', '0e390209-acfb-4b1f-8370-cebe1635bbf5', 'ef5e9af9-ac23-4533-a2b8-590ff6cba3fd', '34777775-80a6-4855-b78f-434501d811e5'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:09 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:09 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:09 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.398s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:09 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Deleted volume successfully. Sep 28 18:14:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-95b7d37d-2191-4817-84c3-2bb340a1355a tempest-CreateVolumesFromSnapshotTest-1386143629 None] Lock "cinder-403d8e15-3111-4a05-b310-d6a67a5b8662-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Flow 'volume_create_manager' (01c2e6f1-2bab-49d3-aafb-eef93a10da6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e87dc7e-c511-4232-a439-75c74762625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e87dc7e-c511-4232-a439-75c74762625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6032e38-a608-4631-aea6-57a95572ac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fded8dade744ecfbd8b4f80db2aceee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:10Z,use_quota=True,user_id='c0efba36f2f14635a05ebe41677da011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4868d63a-662f-47bf-8cdf-8aa7d3fa708c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4868d63a-662f-47bf-8cdf-8aa7d3fa708c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747d7827-6eb5-428e-a8f3-1f7b91019d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747d7827-6eb5-428e-a8f3-1f7b91019d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6032e38-a608-4631-aea6-57a95572ac2d', 'volume_name': 'volume-e6032e38-a608-4631-aea6-57a95572ac2d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914b3a62-61b1-4bdc-9381-e1bb1542948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (914b3a62-61b1-4bdc-9381-e1bb1542948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e1263-7c8f-4e2f-b552-edfe5e2ffa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Volume e6032e38-a608-4631-aea6-57a95572ac2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6032e38-a608-4631-aea6-57a95572ac2d', 'volume_size': 1} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6032e38-a608-4631-aea6-57a95572ac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fded8dade744ecfbd8b4f80db2aceee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:10Z,use_quota=True,user_id='c0efba36f2f14635a05ebe41677da011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Creating volume e6032e38-a608-4631-aea6-57a95572ac2d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:10 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d 1073741824 Sep 28 18:14:10 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d 1073741824" returned: 0 in 0.680s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d Sep 28 18:14:10 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:11 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e1263-7c8f-4e2f-b552-edfe5e2ffa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6032e38-a608-4631-aea6-57a95572ac2d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1479d3f-1a31-40d9-b701-7aeb305cabc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:11 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Volume volume-e6032e38-a608-4631-aea6-57a95572ac2d (e6032e38-a608-4631-aea6-57a95572ac2d): created successfully Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1479d3f-1a31-40d9-b701-7aeb305cabc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Flow 'volume_create_manager' (01c2e6f1-2bab-49d3-aafb-eef93a10da6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b3813a51-c388-4042-bd53-f680bffca539 tempest-VolumesListAdminTestJSON-136148351 None] Created volume successfully. Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Acquiring lock "cinder-e6032e38-a608-4631-aea6-57a95572ac2d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Lock "cinder-e6032e38-a608-4631-aea6-57a95572ac2d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Acquiring lock "cinder-quobyte-e6032e38-a608-4631-aea6-57a95572ac2d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Lock "cinder-quobyte-e6032e38-a608-4631-aea6-57a95572ac2d" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c94e79-7dc7-488d-a4c9-6808da328d44]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "cinder-75b387ad-e7fd-4de0-8aae-e0af47e0ef46-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-75b387ad-e7fd-4de0-8aae-e0af47e0ef46-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:12 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d Sep 28 18:14:12 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "cinder-quobyte-75b387ad-e7fd-4de0-8aae-e0af47e0ef46" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-quobyte-75b387ad-e7fd-4de0-8aae-e0af47e0ef46" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a944983-d3cd-403e-8a90-259931564029]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:12 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 Sep 28 18:14:12 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:13 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d" returned: 0 in 0.576s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:13 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d Sep 28 18:14:13 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:13 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46" returned: 0 in 0.514s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:13 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46 Sep 28 18:14:13 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:13 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e6032e38-a608-4631-aea6-57a95572ac2d" returned: 0 in 0.350s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Lock "cinder-quobyte-e6032e38-a608-4631-aea6-57a95572ac2d" released by "delete_volume" :: held 1.002s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Created reservations ['3f2be359-c5fe-45f2-b606-acaca8869a4c', 'ab5eede1-3239-4e8d-a076-088401113c6b', '55ea1b9c-60de-40ca-9947-f66b7f60a465', '129d6613-f39f-45bd-82a0-2002992294cf'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:13 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-75b387ad-e7fd-4de0-8aae-e0af47e0ef46" returned: 0 in 0.425s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:13 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:13 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-quobyte-75b387ad-e7fd-4de0-8aae-e0af47e0ef46" released by "delete_volume" :: held 1.023s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Created reservations ['55960056-5fa8-4e1e-9c8b-2a136aa2ca62', 'cdd829ae-845b-4139-a202-3838049bea09', 'b82415e9-8305-4854-ad27-d116161d9e19', '091cd8c9-e3c7-43da-aa1b-19d212e9135d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:13 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:13 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:14 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.393s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Deleted volume successfully. Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4bb8096d-742e-4f4a-b2fc-9b7073994ed6 tempest-VolumesListAdminTestJSON-136148351 None] Lock "cinder-e6032e38-a608-4631-aea6-57a95572ac2d-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:14 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.384s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Deleted volume successfully. Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-912f5a93-bae7-4b83-916e-ddd0bb6a9afc tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-75b387ad-e7fd-4de0-8aae-e0af47e0ef46-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Flow 'volume_create_manager' (04edf21e-7235-4d6e-98e4-9474e2b87203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6118c9b9-fc6d-4efe-9398-1c77b40b7baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6118c9b9-fc6d-4efe-9398-1c77b40b7baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-789905302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8158d8-fa54-497d-a38e-c1163db1924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae16070bab141d4be165c7c87dfbe6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:14Z,use_quota=True,user_id='ed8dfcd7147c479d95f8c45239a57f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f4e9a5-0749-424e-80c8-161c7058533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f4e9a5-0749-424e-80c8-161c7058533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfefa325-45fe-48b0-95bb-a9ed56808efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfefa325-45fe-48b0-95bb-a9ed56808efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8158d8-fa54-497d-a38e-c1163db1924a', 'volume_name': 'volume-8e8158d8-fa54-497d-a38e-c1163db1924a', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0f7e7d-7c45-4220-99ad-4e86ad57f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0f7e7d-7c45-4220-99ad-4e86ad57f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6a6bac-ab08-422c-bc46-cab026e6dc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:14 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Volume 8e8158d8-fa54-497d-a38e-c1163db1924a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8158d8-fa54-497d-a38e-c1163db1924a', 'volume_size': 1} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-789905302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8158d8-fa54-497d-a38e-c1163db1924a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae16070bab141d4be165c7c87dfbe6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:14Z,use_quota=True,user_id='ed8dfcd7147c479d95f8c45239a57f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Creating volume 8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:14 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:14 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a 1073741824 Sep 28 18:14:14 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "cinder-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "cinder-quobyte-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-quobyte-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a6446b-a00a-4940-8ea4-11423233f1bd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 Sep 28 18:14:15 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a 1073741824" returned: 0 in 0.587s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Flow 'volume_create_manager' (79643002-b10c-4c7c-915c-4ecaa5101a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7a814f-95e7-4172-b77c-51321f4ab640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7a814f-95e7-4172-b77c-51321f4ab640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1370441031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e68d97-21df-4bc8-92f1-b1413fd7da4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378f529f556a44d6874b04ce9ec3e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:15Z,use_quota=True,user_id='4914835c8d374f7f8fefb47ed5801e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934caec3-1c9a-4dcb-8f13-d68b698e4bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934caec3-1c9a-4dcb-8f13-d68b698e4bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb2665b-04ef-4f6a-a890-5bccc7f645ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb2665b-04ef-4f6a-a890-5bccc7f645ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e68d97-21df-4bc8-92f1-b1413fd7da4e', 'volume_name': 'volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad74ed1-37a5-49e5-a924-9937ec4a60b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad74ed1-37a5-49e5-a924-9937ec4a60b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2046bd4-3fa4-4d24-86b1-53cbefe116d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Volume c9e68d97-21df-4bc8-92f1-b1413fd7da4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e', 'volume_size': 1} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a Sep 28 18:14:15 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761" returned: 0 in 0.398s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761 Sep 28 18:14:15 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a" returned: 0 in 0.271s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.291s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1370441031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e68d97-21df-4bc8-92f1-b1413fd7da4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378f529f556a44d6874b04ce9ec3e98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:15Z,use_quota=True,user_id='4914835c8d374f7f8fefb47ed5801e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Creating volume c9e68d97-21df-4bc8-92f1-b1413fd7da4e {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:15 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6a6bac-ab08-422c-bc46-cab026e6dc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8158d8-fa54-497d-a38e-c1163db1924a', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:15 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e 1073741824 Sep 28 18:14:15 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2212c622-3550-4f5f-a120-b975d27f472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Volume volume-8e8158d8-fa54-497d-a38e-c1163db1924a (8e8158d8-fa54-497d-a38e-c1163db1924a): created successfully Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2212c622-3550-4f5f-a120-b975d27f472c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Flow 'volume_create_manager' (04edf21e-7235-4d6e-98e4-9474e2b87203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-58d82254-8722-4a95-9e15-9641eec07027 tempest-VolumeDependencyTests-44155272 None] Created volume successfully. Sep 28 18:14:15 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761" returned: 0 in 0.270s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-quobyte-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761" released by "delete_volume" :: held 0.723s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Created reservations ['159c48d5-a127-4a16-8958-cb9e8bf10448', '7ce8d57e-56b2-4b5a-934f-65d8da002a61', '00267057-2e5e-4044-8b9f-746460993d92', 'f7e87040-3939-4b98-bbb6-800d171177d4'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:15 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e 1073741824" returned: 0 in 0.518s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e Sep 28 18:14:16 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.334s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Deleted volume successfully. Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8a862ef5-80fa-456b-88fe-2ce16a55c457 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-b6fda2c5-7f7c-4f62-83fb-fa5c8b082761-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "cinder-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "cinder-quobyte-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-quobyte-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3a9ef9-0e6f-4028-bdab-6920e20b4534]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e" returned: 0 in 0.339s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2046bd4-3fa4-4d24-86b1-53cbefe116d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759f5cd7-68c6-40c6-980b-466f21a13f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:16 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Volume volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e (c9e68d97-21df-4bc8-92f1-b1413fd7da4e): created successfully Sep 28 18:14:16 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 Sep 28 18:14:16 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759f5cd7-68c6-40c6-980b-466f21a13f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Flow 'volume_create_manager' (79643002-b10c-4c7c-915c-4ecaa5101a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8f1ad709-8ef5-4450-a073-0b6a6c72f9c4 tempest-VolumesNegativeTest-459742555 None] Created volume successfully. Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Creating offline snapshot 5f87faaa-6a4a-4f62-95dc-70b0490e0756 of volume 8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0bb63b-0dee-40a1-aa98-6a856b04d54d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89" returned: 0 in 0.463s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89 Sep 28 18:14:16 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a Sep 28 18:14:16 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89" returned: 0 in 0.275s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-quobyte-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89" released by "delete_volume" :: held 0.814s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Created reservations ['6a2bc992-fd06-46f8-8b26-a31d74cd4466', '4e3dbb5d-68ee-43a4-9142-3ddfa3f4f022', '2f92b7a8-ca13-4e4b-ab4e-f491c4c58b05', 'd4c29e63-57ca-4698-b604-a29864f1eeb3'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:17 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a" returned: 0 in 0.521s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:17 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:17 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 1G Sep 28 18:14:17 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.356s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Deleted volume successfully. Sep 28 18:14:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-586d1242-63fe-4fd3-b19d-cfda39e9ae43 tempest-VolumesListAdminTestJSON-858450592 None] Lock "cinder-1cd7b7ed-cb55-403d-b4e0-3d48c1407a89-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:18 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 1G" returned: 0 in 0.683s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e8158d8-fa54-497d-a38e-c1163db1924a -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:18 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e8158d8-fa54-497d-a38e-c1163db1924a -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 Sep 28 18:14:18 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:18 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e8158d8-fa54-497d-a38e-c1163db1924a -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756" returned: 0 in 0.400s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 is being set with open permissions: ugo+rw Sep 28 18:14:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:18 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 Sep 28 18:14:18 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:18 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756" returned: 0 in 0.366s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:18 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info Sep 28 18:14:18 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:19 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info" returned: 0 in 0.419s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:19 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info is being set with open permissions: ugo+rw Sep 28 18:14:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:19 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info Sep 28 18:14:19 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:19 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.info" returned: 0 in 0.385s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d1e74973-e1da-4fb9-8e2b-728596f16b2b tempest-VolumeDependencyTests-44155272 None] Create snapshot completed successfully Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Flow 'volume_create_manager' (a66ec1c9-f419-46e2-9933-4be736cd1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3633f3f-0e07-4132-a962-764b75d7a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3633f3f-0e07-4132-a962-764b75d7a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-328764403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f851c41-b048-4fa0-bf0c-b92db6b9a388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae16070bab141d4be165c7c87dfbe6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f87faaa-6a4a-4f62-95dc-70b0490e0756,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:21Z,use_quota=True,user_id='ed8dfcd7147c479d95f8c45239a57f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43398c5-8ca8-4191-856a-2e46292dea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43398c5-8ca8-4191-856a-2e46292dea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a75d9-804a-4837-9674-2ec6de1f3e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95a75d9-804a-4837-9674-2ec6de1f3e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f851c41-b048-4fa0-bf0c-b92db6b9a388', 'volume_name': 'volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388', 'volume_size': 1, 'snapshot_id': '5f87faaa-6a4a-4f62-95dc-70b0490e0756'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91138919-2d3c-4a55-a993-7e0e870fb0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91138919-2d3c-4a55-a993-7e0e870fb0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0550733-6ed6-40d8-956d-026bcda5cf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:21 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Volume 5f851c41-b048-4fa0-bf0c-b92db6b9a388: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388', 'volume_size': 1, 'snapshot_id': '5f87faaa-6a4a-4f62-95dc-70b0490e0756'} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-quobyte-5f87faaa-6a4a-4f62-95dc-70b0490e0756-5f851c41-b048-4fa0-bf0c-b92db6b9a388" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f87faaa-6a4a-4f62-95dc-70b0490e0756-5f851c41-b048-4fa0-bf0c-b92db6b9a388" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Creating volume 5f851c41-b048-4fa0-bf0c-b92db6b9a388 from snapshot 5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-quobyte-5f851c41-b048-4fa0-bf0c-b92db6b9a388" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f851c41-b048-4fa0-bf0c-b92db6b9a388" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] snapshot: 5f87faaa-6a4a-4f62-95dc-70b0490e0756, volume: 5f851c41-b048-4fa0-bf0c-b92db6b9a388, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2fa234-b034-4dba-8f84-0ee9916a2975]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:21 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 Sep 28 18:14:21 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:22 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756" returned: 0 in 0.708s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e8158d8-fa54-497d-a38e-c1163db1924a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b98189-6d12-4e5f-a923-42287e957166]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:22 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a Sep 28 18:14:22 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:22 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a" returned: 0 in 0.490s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:14:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:22 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 Sep 28 18:14:22 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:23 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:24 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.674s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:14:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:14:31 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=39,cinder:INSERT=13,cinder:UPDATE=50,cinder:DELETE=5 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:31 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:INSERT=11,cinder:UPDATE=51,cinder:SELECT=31,cinder:DELETE=4 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:31 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Flow 'volume_create_manager' (23a7352e-680e-4733-8824-b7dfa462ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d1e53b-1680-41d2-8579-af492ba6c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d1e53b-1680-41d2-8579-af492ba6c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-484896545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76abf2b95ade4ee4a54c232a950533f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:32Z,use_quota=True,user_id='7bbd2b9a6bb54e61ae25a08d97d70680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf990118-303b-415d-abf4-70a744d96236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf990118-303b-415d-abf4-70a744d96236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab669600-8cc0-44f9-a094-4c60bad1513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab669600-8cc0-44f9-a094-4c60bad1513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5', 'volume_name': 'volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f973ef-33ee-4380-83c9-d4630a614254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f973ef-33ee-4380-83c9-d4630a614254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f80bad-522c-4da6-a9d7-7bc7b130f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:32 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Volume 9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5', 'volume_size': 1} Sep 28 18:14:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:33 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388" returned: 0 in 10.929s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a, size 1024.00 MB, duration 10.93 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:14:33 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Converted 1024.00 MB image at 93.69 MB/s Sep 28 18:14:33 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 is being set with open permissions: ugo+rw Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:33 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 Sep 28 18:14:33 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:33 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388" returned: 0 in 0.344s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f851c41-b048-4fa0-bf0c-b92db6b9a388" released by "_copy_volume_from_snapshot" :: held 12.636s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f87faaa-6a4a-4f62-95dc-70b0490e0756-5f851c41-b048-4fa0-bf0c-b92db6b9a388" released by "_create_volume_from_snapshot" :: held 12.731s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.758s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.758s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-484896545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76abf2b95ade4ee4a54c232a950533f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:32Z,use_quota=True,user_id='7bbd2b9a6bb54e61ae25a08d97d70680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Creating volume 9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:34 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:34 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 1073741824 Sep 28 18:14:34 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0550733-6ed6-40d8-956d-026bcda5cf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388', 'volume_size': 1, 'snapshot_id': '5f87faaa-6a4a-4f62-95dc-70b0490e0756'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdce0bf-3cb8-42e8-8d88-5e912133cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Volume volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 (5f851c41-b048-4fa0-bf0c-b92db6b9a388): created successfully Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdce0bf-3cb8-42e8-8d88-5e912133cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Flow 'volume_create_manager' (a66ec1c9-f419-46e2-9933-4be736cd1888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9d155439-22b0-437d-b91d-383c24d27358 tempest-VolumeDependencyTests-44155272 None] Created volume successfully. Sep 28 18:14:34 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 1073741824" returned: 0 in 0.654s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:34 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 Sep 28 18:14:34 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-5f87faaa-6a4a-4f62-95dc-70b0490e0756-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-5f87faaa-6a4a-4f62-95dc-70b0490e0756-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-quobyte-8e8158d8-fa54-497d-a38e-c1163db1924a" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-8e8158d8-fa54-497d-a38e-c1163db1924a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-quobyte-5f87faaa-6a4a-4f62-95dc-70b0490e0756" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f87faaa-6a4a-4f62-95dc-70b0490e0756" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Deleting offline snapshot 5f87faaa-6a4a-4f62-95dc-70b0490e0756 of volume 8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] snapshot_file for this snap is: volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[015b244a-bf8f-4e0d-973f-4bcd61c6d579]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:35 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5" returned: 0 in 0.501s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f80bad-522c-4da6-a9d7-7bc7b130f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6b999c-f90f-4f77-8c1f-30ae1f924c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Volume volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 (9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5): created successfully Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6b999c-f90f-4f77-8c1f-30ae1f924c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Flow 'volume_create_manager' (23a7352e-680e-4733-8824-b7dfa462ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4beb1e2e-7361-4479-8a4c-e139195e1ec8 tempest-VolumesTransfersV355Test-10890594 None] Created volume successfully. Sep 28 18:14:35 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 Sep 28 18:14:35 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:35 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756" returned: 0 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e8158d8-fa54-497d-a38e-c1163db1924a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d160ee52-c333-4a6d-a021-28358b5a3d5d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:35 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a Sep 28 18:14:35 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:36 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a" returned: 0 in 0.698s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:36 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 Sep 28 18:14:36 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:36 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756" returned: 0 in 0.415s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:36 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756 Sep 28 18:14:36 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:37 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a.5f87faaa-6a4a-4f62-95dc-70b0490e0756" returned: 0 in 0.302s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fb214fdc-baa4-485a-88da-449015300d48 tempest-VolumesTransfersV355Test-2115498896 None] Transfer volume completed successfully. Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f87faaa-6a4a-4f62-95dc-70b0490e0756" released by "_delete_snapshot" :: held 2.124s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-8e8158d8-fa54-497d-a38e-c1163db1924a" released by "delete_snapshot" :: held 2.163s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Created reservations ['7f03fb6b-5ac5-42b8-8cb5-dafc05a755af', 'aaa31a33-9eec-486f-8f3f-c1fc95dabd9b', '683ea413-4e6c-4b5f-bed4-171047d248d2', '91cdfc94-a60e-43fe-849b-d4c75afd0c54'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Delete snapshot completed successfully. Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59e072a4-b5c3-4645-8057-987d7366d567 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-5f87faaa-6a4a-4f62-95dc-70b0490e0756-delete_snapshot" released by "delete_snapshot" :: held 2.501s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Acquiring lock "cinder-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Acquiring lock "cinder-quobyte-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-quobyte-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea51c1-4f5a-4cb6-860b-6f93844d9569]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 Sep 28 18:14:38 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-8e8158d8-fa54-497d-a38e-c1163db1924a-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-8e8158d8-fa54-497d-a38e-c1163db1924a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-quobyte-8e8158d8-fa54-497d-a38e-c1163db1924a" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-8e8158d8-fa54-497d-a38e-c1163db1924a" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85368de-f27a-4783-8421-4783596907ef]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5" returned: 0 in 0.561s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5 Sep 28 18:14:38 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a Sep 28 18:14:38 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:38 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5" returned: 0 in 0.308s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-quobyte-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5" released by "delete_volume" :: held 0.923s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:38 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Created reservations ['4f6de5e0-4a47-4325-bcba-655af4052c13', '3f7ccfec-9b5a-43ef-aa7d-521b13d513c8', 'c88ea0eb-463f-4c7d-a7ac-038f66f74cc5', '3b47f09b-98c6-461e-a69b-606279f33157'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:38 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a Sep 28 18:14:38 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:39 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8e8158d8-fa54-497d-a38e-c1163db1924a" returned: 0 in 0.368s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-8e8158d8-fa54-497d-a38e-c1163db1924a" released by "delete_volume" :: held 0.905s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Created reservations ['860d58fb-7d5f-49ed-af2f-5c62524937bc', 'f9317d71-7bed-47b8-859f-fc043306d7f0', 'e8170840-dd02-442e-8131-256399e0919d', '0eb8f3fa-0735-49cc-8cee-fef03f16fb26'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:39 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.334s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Deleted volume successfully. Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ace3fb46-dd47-491e-b61a-f082716f794c tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-9b02aa5d-55dc-4f68-9e32-1a5d04aef7b5-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:39 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:39 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-5f851c41-b048-4fa0-bf0c-b92db6b9a388-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-5f851c41-b048-4fa0-bf0c-b92db6b9a388-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "cinder-quobyte-5f851c41-b048-4fa0-bf0c-b92db6b9a388" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f851c41-b048-4fa0-bf0c-b92db6b9a388" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b2979b-d35d-4594-a9f7-6251840708ed]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.325s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Deleted volume successfully. Sep 28 18:14:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-68fdf3c1-1ab8-4668-881c-565310bb6738 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-8e8158d8-fa54-497d-a38e-c1163db1924a-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:39 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 Sep 28 18:14:39 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388" returned: 0 in 0.508s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:40 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388 Sep 28 18:14:40 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5f851c41-b048-4fa0-bf0c-b92db6b9a388" returned: 0 in 0.331s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-quobyte-5f851c41-b048-4fa0-bf0c-b92db6b9a388" released by "delete_volume" :: held 0.900s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Created reservations ['6abda7ca-b39d-42fc-a74c-b3ebfd1b4483', 'ef611c66-7528-4084-ad9b-a63f534ac2af', '820ad233-c478-4eef-9e05-6e5877b5d06b', 'c1e2f4d8-cfe6-4196-b7d7-c07c7edc655c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:40 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:40 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Flow 'volume_create_manager' (b7cb1297-bb21-46b4-9fbb-8f86a2ceb403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ee1b6d-a938-4446-a47d-cc67b4971dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ee1b6d-a938-4446-a47d-cc67b4971dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-853855595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d2dc15-ff7f-4e54-9c3f-7936e807b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76abf2b95ade4ee4a54c232a950533f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:41Z,use_quota=True,user_id='7bbd2b9a6bb54e61ae25a08d97d70680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709e63ba-8728-4462-8caa-c022f9663c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709e63ba-8728-4462-8caa-c022f9663c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064eeff6-0950-48fb-9df2-35c92139ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064eeff6-0950-48fb-9df2-35c92139ac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d2dc15-ff7f-4e54-9c3f-7936e807b514', 'volume_name': 'volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ca408b-9700-42c1-ba67-9b996c331354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ca408b-9700-42c1-ba67-9b996c331354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053ced1b-3f50-4766-83b1-292526e73827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Volume f5d2dc15-ff7f-4e54-9c3f-7936e807b514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514', 'volume_size': 1} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-853855595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d2dc15-ff7f-4e54-9c3f-7936e807b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76abf2b95ade4ee4a54c232a950533f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:41Z,use_quota=True,user_id='7bbd2b9a6bb54e61ae25a08d97d70680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Creating volume f5d2dc15-ff7f-4e54-9c3f-7936e807b514 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:41 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 1073741824 Sep 28 18:14:41 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:41 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.318s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Deleted volume successfully. Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1778b761-ec01-4273-81a9-8afc61cd6240 tempest-VolumeDependencyTests-44155272 None] Lock "cinder-5f851c41-b048-4fa0-bf0c-b92db6b9a388-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:41 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 1073741824" returned: 0 in 0.646s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 Sep 28 18:14:41 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:42 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514" returned: 0 in 0.318s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053ced1b-3f50-4766-83b1-292526e73827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb840743-0fcb-4d91-9bcf-89a2962f2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Volume volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 (f5d2dc15-ff7f-4e54-9c3f-7936e807b514): created successfully Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb840743-0fcb-4d91-9bcf-89a2962f2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Flow 'volume_create_manager' (b7cb1297-bb21-46b4-9fbb-8f86a2ceb403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b6499370-824f-458c-9668-908d74216ac4 tempest-VolumesTransfersV355Test-10890594 None] Created volume successfully. Sep 28 18:14:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Acquiring lock "cinder-f5d2dc15-ff7f-4e54-9c3f-7936e807b514-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-f5d2dc15-ff7f-4e54-9c3f-7936e807b514-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Acquiring lock "cinder-quobyte-f5d2dc15-ff7f-4e54-9c3f-7936e807b514" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-quobyte-f5d2dc15-ff7f-4e54-9c3f-7936e807b514" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04b1e4-ee03-4b3f-85b1-3d3dc55e8b83]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:43 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 Sep 28 18:14:43 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:44 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:44 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514 Sep 28 18:14:44 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:44 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5d2dc15-ff7f-4e54-9c3f-7936e807b514" returned: 0 in 0.340s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-quobyte-f5d2dc15-ff7f-4e54-9c3f-7936e807b514" released by "delete_volume" :: held 0.889s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Created reservations ['5c7b4b72-fe40-48ab-a85f-7c2116bbec1d', 'ab5d5875-a5f0-42a5-a6e5-89eec20955a6', '8f0fd133-7827-4503-8f39-c15d129c0272', '0a8e6011-9b1d-4b70-8f03-777c2f2b0008'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:44 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:44 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:45 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.392s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:45 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Deleted volume successfully. Sep 28 18:14:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08b64f22-6d6d-417b-ba10-726027690d4d tempest-VolumesTransfersV355Test-567817249 None] Lock "cinder-f5d2dc15-ff7f-4e54-9c3f-7936e807b514-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Acquiring lock "cinder-c9e68d97-21df-4bc8-92f1-b1413fd7da4e-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Lock "cinder-c9e68d97-21df-4bc8-92f1-b1413fd7da4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Acquiring lock "cinder-quobyte-c9e68d97-21df-4bc8-92f1-b1413fd7da4e" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Lock "cinder-quobyte-c9e68d97-21df-4bc8-92f1-b1413fd7da4e" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[586933ef-2886-4866-bb65-6db2e26869eb]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:46 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e Sep 28 18:14:46 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:46 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e" returned: 0 in 0.614s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:47 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e Sep 28 18:14:47 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:47 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c9e68d97-21df-4bc8-92f1-b1413fd7da4e" returned: 0 in 0.336s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Lock "cinder-quobyte-c9e68d97-21df-4bc8-92f1-b1413fd7da4e" released by "delete_volume" :: held 1.029s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Created reservations ['e2fbcb98-618b-4525-b236-2d87f36c755e', 'ec5327d9-5ef6-4aa5-af99-285dfeb5da56', 'eb4ae778-ddad-4371-8a67-4bceeb305b01', '3d8a089d-d812-47fd-937a-11ff903c8ee4'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:47 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:14:47 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:47 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Deleted volume successfully. Sep 28 18:14:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d474b27b-31f2-42d0-8fe5-4b2268e29fcc tempest-VolumesNegativeTest-459742555 None] Lock "cinder-c9e68d97-21df-4bc8-92f1-b1413fd7da4e-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Flow 'volume_create_manager' (f74f9dcd-eb00-4c76-a22d-d571b2e1c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8170c976-100e-4f6f-9e01-3ba9668c4c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8170c976-100e-4f6f-9e01-3ba9668c4c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-960094996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134f64e7-5f2e-462f-a793-d7a0d70d30bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0790a7d2e1dc45408f8a20ccea3cfa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:56Z,use_quota=True,user_id='3f2cd7c2f66849eb8bf4827d829019df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd1e51b-37bc-4abb-9b4e-95db8ed92782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd1e51b-37bc-4abb-9b4e-95db8ed92782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff146d7-c3d7-4e65-a661-b7f9ed318e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff146d7-c3d7-4e65-a661-b7f9ed318e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134f64e7-5f2e-462f-a793-d7a0d70d30bf', 'volume_name': 'volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf', 'volume_size': 2}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f533b5-682d-4102-9c9a-2f4ace0701ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f533b5-682d-4102-9c9a-2f4ace0701ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9660ff59-f46f-48b4-8c87-24e17f862e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Volume 134f64e7-5f2e-462f-a793-d7a0d70d30bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf', 'volume_size': 2} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-960094996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134f64e7-5f2e-462f-a793-d7a0d70d30bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0790a7d2e1dc45408f8a20ccea3cfa80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:56Z,use_quota=True,user_id='3f2cd7c2f66849eb8bf4827d829019df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Creating volume 134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:55 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf 2147483648 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:56 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf 2147483648 Sep 28 18:14:56 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:56 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf 2147483648" returned: 0 in 0.682s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:56 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf Sep 28 18:14:56 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:57 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf" returned: 0 in 0.329s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9660ff59-f46f-48b4-8c87-24e17f862e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf', 'volume_size': 2}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1831e2c-4092-40bc-bd18-6085a7be6754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Volume volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf (134f64e7-5f2e-462f-a793-d7a0d70d30bf): created successfully Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1831e2c-4092-40bc-bd18-6085a7be6754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Flow 'volume_create_manager' (f74f9dcd-eb00-4c76-a22d-d571b2e1c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-275b5729-ccda-4615-bfc1-aa865fd781d9 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Created volume successfully. Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Flow 'volume_create_manager' (e9a9c0dd-14ea-4cb0-bfba-73c44275022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cceff532-2d5c-4bdb-bc55-7d1e402e0d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cceff532-2d5c-4bdb-bc55-7d1e402e0d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2092313059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7a48b3-e081-45b8-bb2f-aaaea37087d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540f7b8c8c124d30adab1057af950f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:58Z,use_quota=True,user_id='1e3c38249ff64a71bdd7178c7ca2526a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13a7af1-38e5-4f23-af77-f0e45d429852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13a7af1-38e5-4f23-af77-f0e45d429852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d7af26-2c32-446e-8bcc-22716192fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d7af26-2c32-446e-8bcc-22716192fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7a48b3-e081-45b8-bb2f-aaaea37087d5', 'volume_name': 'volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6d1575-8aeb-4c48-847c-11cb6fba7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6d1575-8aeb-4c48-847c-11cb6fba7394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c6524a-243d-4e4e-960b-3cd31d710fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Volume fb7a48b3-e081-45b8-bb2f-aaaea37087d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5', 'volume_size': 1} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2092313059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7a48b3-e081-45b8-bb2f-aaaea37087d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540f7b8c8c124d30adab1057af950f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:58Z,use_quota=True,user_id='1e3c38249ff64a71bdd7178c7ca2526a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Creating volume fb7a48b3-e081-45b8-bb2f-aaaea37087d5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:57 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:14:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:57 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 1073741824 Sep 28 18:14:57 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:58 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 1073741824" returned: 0 in 0.780s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:58 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 Sep 28 18:14:58 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:58 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5" returned: 0 in 0.346s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.580s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15c6524a-243d-4e4e-960b-3cd31d710fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731a3c65-5e0a-469d-b458-f3086c2124a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Creating offline snapshot 34de37d4-b3f6-47f1-b7a1-a9d325cc09ca of volume 134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:14:58 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Volume volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 (fb7a48b3-e081-45b8-bb2f-aaaea37087d5): created successfully Sep 28 18:14:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731a3c65-5e0a-469d-b458-f3086c2124a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:59 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Flow 'volume_create_manager' (e9a9c0dd-14ea-4cb0-bfba-73c44275022f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4aa3c1-4486-4749-9e14-8e65c18434b6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-706e9af6-e570-4336-9b6b-be51fc14c0e8 tempest-VolumesTransfersV357Test-74316776 None] Created volume successfully. Sep 28 18:14:59 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf Sep 28 18:14:59 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:59 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf" returned: 0 in 0.529s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca 2G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:59 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca 2G Sep 28 18:14:59 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:00 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca 2G" returned: 0 in 0.640s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:00 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca Sep 28 18:15:00 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:00 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" returned: 0 in 0.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:00 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca is being set with open permissions: ugo+rw Sep 28 18:15:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:00 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca Sep 28 18:15:00 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:00 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3e774d22-b69a-40f5-af4a-909a79dad610 tempest-VolumesTransfersV357Test-445948571 None] Transfer volume completed successfully. Sep 28 18:15:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" returned: 0 in 0.343s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:01 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info Sep 28 18:15:01 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:01 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:01 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info is being set with open permissions: ugo+rw Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:01 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info Sep 28 18:15:01 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:01 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Acquiring lock "cinder-fb7a48b3-e081-45b8-bb2f-aaaea37087d5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.info" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-fb7a48b3-e081-45b8-bb2f-aaaea37087d5-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-66cfb1ae-5ed9-46cd-995a-bbc8d964b608 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Create snapshot completed successfully Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Acquiring lock "cinder-quobyte-fb7a48b3-e081-45b8-bb2f-aaaea37087d5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-quobyte-fb7a48b3-e081-45b8-bb2f-aaaea37087d5" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1d949-0531-4cd4-a22e-92ade9aabd71]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:02 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 Sep 28 18:15:02 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:02 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5" returned: 0 in 0.410s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:02 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5 Sep 28 18:15:02 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "cinder-34de37d4-b3f6-47f1-b7a1-a9d325cc09ca-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-34de37d4-b3f6-47f1-b7a1-a9d325cc09ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "cinder-quobyte-134f64e7-5f2e-462f-a793-d7a0d70d30bf" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:02 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fb7a48b3-e081-45b8-bb2f-aaaea37087d5" returned: 0 in 0.343s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-quobyte-134f64e7-5f2e-462f-a793-d7a0d70d30bf" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "cinder-quobyte-34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-quobyte-fb7a48b3-e081-45b8-bb2f-aaaea37087d5" released by "delete_volume" :: held 0.816s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-quobyte-34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Deleting offline snapshot 34de37d4-b3f6-47f1-b7a1-a9d325cc09ca of volume 134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] snapshot_file for this snap is: volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9625fa1c-c7ec-4dfb-8916-e05a4178196f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:02 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Created reservations ['5e93c3a5-90b8-47ce-a572-95f25946c730', '7b08a69f-76b1-4d4c-9b69-92798c93cbdd', 'acfbf390-d47a-4cb1-91fd-03bfaa720078', '7e0bb76a-fd1a-4b18-b0ea-9abb80b7fba1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:02 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca Sep 28 18:15:02 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:15:03 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:03 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:03 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Deleted volume successfully. Sep 28 18:15:03 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" returned: 0 in 0.562s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ac0d07c2-206e-4de0-8bfd-a70a4ffbe7c4 tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-fb7a48b3-e081-45b8-bb2f-aaaea37087d5-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[569de98a-d99a-483d-ac88-db7cc368b293]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf Sep 28 18:15:03 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Flow 'volume_create_manager' (db77c3d1-d861-4b82-aa82-051643018249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ccedf-c113-4f91-a835-2984dea56038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1ccedf-c113-4f91-a835-2984dea56038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-330770033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b2fb65-6ec0-4b85-9111-d6e26facf3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540f7b8c8c124d30adab1057af950f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:04Z,use_quota=True,user_id='1e3c38249ff64a71bdd7178c7ca2526a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6272731e-287b-4231-b5d1-70dbfc5186a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6272731e-287b-4231-b5d1-70dbfc5186a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1025ff8-5e77-43f4-bb52-8d11a4823caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1025ff8-5e77-43f4-bb52-8d11a4823caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b2fb65-6ec0-4b85-9111-d6e26facf3d4', 'volume_name': 'volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a624406e-ec27-423f-91e5-57325efd6637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a624406e-ec27-423f-91e5-57325efd6637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6c7e3a-eba7-4975-ab9b-7b2cf89f3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:03 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Volume d5b2fb65-6ec0-4b85-9111-d6e26facf3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4', 'volume_size': 1} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-330770033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b2fb65-6ec0-4b85-9111-d6e26facf3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540f7b8c8c124d30adab1057af950f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:04Z,use_quota=True,user_id='1e3c38249ff64a71bdd7178c7ca2526a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Creating volume d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:03 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:15:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 1073741824 Sep 28 18:15:03 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf" returned: 0 in 0.558s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:04 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca Sep 28 18:15:04 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" returned: 0 in 0.542s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:04 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca Sep 28 18:15:04 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 1073741824" returned: 0 in 0.738s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:04 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 Sep 28 18:15:04 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf.34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" returned: 0 in 0.400s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-quobyte-34de37d4-b3f6-47f1-b7a1-a9d325cc09ca" released by "_delete_snapshot" :: held 2.214s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-quobyte-134f64e7-5f2e-462f-a793-d7a0d70d30bf" released by "delete_snapshot" :: held 2.253s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:05 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4" returned: 0 in 0.361s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6c7e3a-eba7-4975-ab9b-7b2cf89f3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ae9189-89a9-45f9-afcc-87660d67fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Created reservations ['dc0a2f6e-d9c5-4f82-96b2-054a7ed49c12', '5be0e258-0dcd-4b4a-8d65-fbd43e64b269', '8c1cb28f-9a9d-4df3-8621-9ee9f7fbd009', '0c376c46-d563-4077-81ff-31b5d64e94aa'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Volume volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 (d5b2fb65-6ec0-4b85-9111-d6e26facf3d4): created successfully Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ae9189-89a9-45f9-afcc-87660d67fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Flow 'volume_create_manager' (db77c3d1-d861-4b82-aa82-051643018249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d913098e-028d-4267-8ed6-5994173bb436 tempest-VolumesTransfersV357Test-74316776 None] Created volume successfully. Sep 28 18:15:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Delete snapshot completed successfully. Sep 28 18:15:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2658bc00-f6c0-4389-8d15-35c39b54a7b8 tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-34de37d4-b3f6-47f1-b7a1-a9d325cc09ca-delete_snapshot" released by "delete_snapshot" :: held 2.501s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "cinder-134f64e7-5f2e-462f-a793-d7a0d70d30bf-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-134f64e7-5f2e-462f-a793-d7a0d70d30bf-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "cinder-quobyte-134f64e7-5f2e-462f-a793-d7a0d70d30bf" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-quobyte-134f64e7-5f2e-462f-a793-d7a0d70d30bf" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39aedea-09be-470f-9f7a-61d01ced5061]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Acquiring lock "cinder-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Acquiring lock "cinder-quobyte-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-quobyte-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0fc84e-eeb4-4dfd-b1d6-ac4d701ade0d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:06 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf Sep 28 18:15:06 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:06 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 Sep 28 18:15:06 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf" returned: 0 in 0.639s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:07 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf Sep 28 18:15:07 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4" returned: 0 in 0.737s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:07 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-134f64e7-5f2e-462f-a793-d7a0d70d30bf" returned: 0 in 0.383s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4 Sep 28 18:15:07 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-quobyte-134f64e7-5f2e-462f-a793-d7a0d70d30bf" released by "delete_volume" :: held 1.131s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Created reservations ['b7d739ce-9c24-46a8-a71c-ef7ed8f51c84', '3029d153-f6f6-4fd4-a5e2-80d9ffaa33de', '4d2f0988-8e8c-4270-bd00-7085781a28a3', 'a6e2ff00-9a75-410a-88fb-2c335ff100aa'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:07 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:15:07 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4" returned: 0 in 0.437s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-quobyte-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4" released by "delete_volume" :: held 1.243s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Created reservations ['fd1d8bb9-83a1-4b05-b9b7-406d477f6cf6', 'fc6f4147-79d8-4273-a21c-2090954b4e79', '70d38f26-c9bb-42c0-8a53-4400b5cbdd71', '26135bd9-3658-4962-a215-9135646847b6'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:08 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.336s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Deleted volume successfully. Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-72432fc4-e3f7-482f-b65f-c2e9ead099ee tempest-VolumesSnapshotNegativeTestJSON-1017916502 None] Lock "cinder-134f64e7-5f2e-462f-a793-d7a0d70d30bf-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:08 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:15:08 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:08 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.306s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Deleted volume successfully. Sep 28 18:15:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-20fbfd69-9606-46b7-abcd-49bdca22f3da tempest-VolumesTransfersV357Test-961726742 None] Lock "cinder-d5b2fb65-6ec0-4b85-9111-d6e26facf3d4-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Flow 'volume_create_manager' (6f22bfc7-de43-4a32-8af6-edc84e94b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e09a0ef-496f-4200-80d5-9b4a41b16bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e09a0ef-496f-4200-80d5-9b4a41b16bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1015720811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1602d3c4-86fa-49e4-9062-db49356cb07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064b53ef0c0c403187871a4c7165b07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:14Z,use_quota=True,user_id='0bb8a28b72824eb2a9f8ea85749d31b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3804420a-826b-4301-b50d-0472d30f4ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3804420a-826b-4301-b50d-0472d30f4ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0239408-73b7-4c4f-b768-5cf286a59549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0239408-73b7-4c4f-b768-5cf286a59549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1602d3c4-86fa-49e4-9062-db49356cb07f', 'volume_name': 'volume-1602d3c4-86fa-49e4-9062-db49356cb07f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121334eb-87c8-41e8-a169-54c6c36f40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121334eb-87c8-41e8-a169-54c6c36f40e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e94f27-08c0-4f91-8d3c-9887bef2f6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:13 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Volume 1602d3c4-86fa-49e4-9062-db49356cb07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1602d3c4-86fa-49e4-9062-db49356cb07f', 'volume_size': 1} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1015720811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1602d3c4-86fa-49e4-9062-db49356cb07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064b53ef0c0c403187871a4c7165b07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:14Z,use_quota=True,user_id='0bb8a28b72824eb2a9f8ea85749d31b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Creating volume 1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:13 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:15:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:13 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f 1073741824 Sep 28 18:15:13 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:14 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f 1073741824" returned: 0 in 0.766s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:14 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f Sep 28 18:15:14 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:15 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f" returned: 0 in 0.458s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e94f27-08c0-4f91-8d3c-9887bef2f6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1602d3c4-86fa-49e4-9062-db49356cb07f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be46ef42-0f31-4eec-8732-1da5593f511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Volume volume-1602d3c4-86fa-49e4-9062-db49356cb07f (1602d3c4-86fa-49e4-9062-db49356cb07f): created successfully Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be46ef42-0f31-4eec-8732-1da5593f511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Flow 'volume_create_manager' (6f22bfc7-de43-4a32-8af6-edc84e94b55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-df1bff91-49a9-4507-b010-03470c13bbee tempest-SnapshotDependencyTests-117621173 None] Created volume successfully. Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Creating offline snapshot a42bcbed-b425-476e-91c4-d23b6cd55c7a of volume 1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ba573-5d31-435e-bf65-d35b82a85a19]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:16 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f Sep 28 18:15:16 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:16 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f" returned: 0 in 0.574s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:17 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a 1G Sep 28 18:15:17 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:17 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a 1G" returned: 0 in 0.689s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1602d3c4-86fa-49e4-9062-db49356cb07f -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:17 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1602d3c4-86fa-49e4-9062-db49356cb07f -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a Sep 28 18:15:17 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:18 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1602d3c4-86fa-49e4-9062-db49356cb07f -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a" returned: 0 in 0.410s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:18 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a is being set with open permissions: ugo+rw Sep 28 18:15:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:18 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a Sep 28 18:15:18 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:18 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a" returned: 0 in 0.390s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:18 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info Sep 28 18:15:18 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:18 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info" returned: 0 in 0.437s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:18 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info is being set with open permissions: ugo+rw Sep 28 18:15:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:19 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info Sep 28 18:15:19 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:19 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.info" returned: 0 in 0.370s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.055s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-905769ee-30b3-4d40-8ed4-99bbe7e69db4 tempest-SnapshotDependencyTests-117621173 None] Create snapshot completed successfully Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Flow 'volume_create_manager' (f4d25fe5-5a76-4dd2-8297-c1cf8b263605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f015823-44ef-4b3f-b7f4-e6220e152f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f015823-44ef-4b3f-b7f4-e6220e152f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033f173e-48d1-4149-9791-9db3c8e894ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064b53ef0c0c403187871a4c7165b07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a42bcbed-b425-476e-91c4-d23b6cd55c7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:22Z,use_quota=True,user_id='0bb8a28b72824eb2a9f8ea85749d31b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa532c0-a759-4c85-8ae4-552fb42ab2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa532c0-a759-4c85-8ae4-552fb42ab2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc88fbb-9a44-4c9b-9793-fa4ea8827b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc88fbb-9a44-4c9b-9793-fa4ea8827b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '033f173e-48d1-4149-9791-9db3c8e894ec', 'volume_name': 'volume-033f173e-48d1-4149-9791-9db3c8e894ec', 'volume_size': 1, 'snapshot_id': 'a42bcbed-b425-476e-91c4-d23b6cd55c7a'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c953972f-11af-4550-b6c2-300465136126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c953972f-11af-4550-b6c2-300465136126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6335c391-5398-4e23-9f16-9feed2ac6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:21 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Volume 033f173e-48d1-4149-9791-9db3c8e894ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-033f173e-48d1-4149-9791-9db3c8e894ec', 'volume_size': 1, 'snapshot_id': 'a42bcbed-b425-476e-91c4-d23b6cd55c7a'} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-quobyte-a42bcbed-b425-476e-91c4-d23b6cd55c7a-033f173e-48d1-4149-9791-9db3c8e894ec" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-a42bcbed-b425-476e-91c4-d23b6cd55c7a-033f173e-48d1-4149-9791-9db3c8e894ec" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Creating volume 033f173e-48d1-4149-9791-9db3c8e894ec from snapshot a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-quobyte-033f173e-48d1-4149-9791-9db3c8e894ec" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-033f173e-48d1-4149-9791-9db3c8e894ec" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] snapshot: a42bcbed-b425-476e-91c4-d23b6cd55c7a, volume: 033f173e-48d1-4149-9791-9db3c8e894ec, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e634f-78fd-4de3-a069-e50ac83c7ccd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:22 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a Sep 28 18:15:22 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:22 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a" returned: 0 in 0.563s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1602d3c4-86fa-49e4-9062-db49356cb07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:22 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c1566-7517-42c0-89d9-2709dbb28a8c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:22 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f Sep 28 18:15:22 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:23 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f" returned: 0 in 0.600s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:23 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec Sep 28 18:15:23 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:23 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:15:23 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:24 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.675s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:15:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:15:31 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=103,cinder:SELECT=81,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:31 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=68,cinder:UPDATE=95,cinder:DELETE=9,cinder:INSERT=22 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:32 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec" returned: 0 in 9.768s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:32 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f, size 1024.00 MB, duration 9.77 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:15:32 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Converted 1024.00 MB image at 104.82 MB/s Sep 28 18:15:32 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec is being set with open permissions: ugo+rw Sep 28 18:15:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:32 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec Sep 28 18:15:32 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:33 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec" returned: 0 in 0.416s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-033f173e-48d1-4149-9791-9db3c8e894ec" released by "_copy_volume_from_snapshot" :: held 11.488s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-a42bcbed-b425-476e-91c4-d23b6cd55c7a-033f173e-48d1-4149-9791-9db3c8e894ec" released by "_create_volume_from_snapshot" :: held 11.590s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.612s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6335c391-5398-4e23-9f16-9feed2ac6014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-033f173e-48d1-4149-9791-9db3c8e894ec', 'volume_size': 1, 'snapshot_id': 'a42bcbed-b425-476e-91c4-d23b6cd55c7a'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80facd93-c78d-4ab3-b07f-84e3e4ce6d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Volume volume-033f173e-48d1-4149-9791-9db3c8e894ec (033f173e-48d1-4149-9791-9db3c8e894ec): created successfully Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80facd93-c78d-4ab3-b07f-84e3e4ce6d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Flow 'volume_create_manager' (f4d25fe5-5a76-4dd2-8297-c1cf8b263605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8ba1e2d5-cd10-41cc-bf7f-8fbd10107f1e tempest-SnapshotDependencyTests-117621173 None] Created volume successfully. Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-a42bcbed-b425-476e-91c4-d23b6cd55c7a-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-a42bcbed-b425-476e-91c4-d23b6cd55c7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-quobyte-1602d3c4-86fa-49e4-9062-db49356cb07f" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-1602d3c4-86fa-49e4-9062-db49356cb07f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-quobyte-a42bcbed-b425-476e-91c4-d23b6cd55c7a" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-a42bcbed-b425-476e-91c4-d23b6cd55c7a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Deleting offline snapshot a42bcbed-b425-476e-91c4-d23b6cd55c7a of volume 1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] snapshot_file for this snap is: volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f9a979-dc62-41ab-abce-1c2141f2e732]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:34 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a Sep 28 18:15:34 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:35 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a" returned: 0 in 0.531s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1602d3c4-86fa-49e4-9062-db49356cb07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:35 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[37231fc2-0a4e-4851-a314-0a21fd515553]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:35 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f Sep 28 18:15:35 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:35 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f" returned: 0 in 0.892s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:36 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a Sep 28 18:15:36 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:36 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a" returned: 0 in 0.504s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:36 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a Sep 28 18:15:36 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:36 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f.a42bcbed-b425-476e-91c4-d23b6cd55c7a" returned: 0 in 0.470s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-a42bcbed-b425-476e-91c4-d23b6cd55c7a" released by "_delete_snapshot" :: held 2.605s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-1602d3c4-86fa-49e4-9062-db49356cb07f" released by "delete_snapshot" :: held 2.638s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Created reservations ['b1655ff1-b79b-45d7-b1b3-d97b65b3b425', '74f86293-1e0f-4e38-b1ba-d2d303a283f1', '9b54f718-54a2-458e-8fb6-1da800f267f3', '542abaae-4f01-4c4b-a58a-0612cc969304'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Delete snapshot completed successfully. Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-38c8cd4c-cb5b-4dbe-91b7-0f762f6a2066 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-a42bcbed-b425-476e-91c4-d23b6cd55c7a-delete_snapshot" released by "delete_snapshot" :: held 2.925s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-1602d3c4-86fa-49e4-9062-db49356cb07f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-1602d3c4-86fa-49e4-9062-db49356cb07f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-quobyte-1602d3c4-86fa-49e4-9062-db49356cb07f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-1602d3c4-86fa-49e4-9062-db49356cb07f" acquired by "delete_volume" :: waited 0.048s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf40d76a-e178-41c2-a3bc-152119bfebb3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:38 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f Sep 28 18:15:38 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:38 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f" returned: 0 in 0.559s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:38 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f Sep 28 18:15:38 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:38 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1602d3c4-86fa-49e4-9062-db49356cb07f" returned: 0 in 0.409s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-1602d3c4-86fa-49e4-9062-db49356cb07f" released by "delete_volume" :: held 1.095s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Created reservations ['6a585f9a-0b5a-444b-aae2-43c0091bfd5a', '0fc7b425-4faa-42d9-8f8f-f09d9a3d93b5', '4794f593-78ac-401f-ab77-d3d27ef4cb3b', 'ac0f5b2c-b74d-40a3-b627-524bc4e4119f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:39 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:15:39 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:39 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.413s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Deleted volume successfully. Sep 28 18:15:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2728c432-bfb1-461d-a865-087807a56e53 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-1602d3c4-86fa-49e4-9062-db49356cb07f-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-033f173e-48d1-4149-9791-9db3c8e894ec-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-033f173e-48d1-4149-9791-9db3c8e894ec-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "cinder-quobyte-033f173e-48d1-4149-9791-9db3c8e894ec" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-033f173e-48d1-4149-9791-9db3c8e894ec" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a5157-3185-4d0f-9bf5-84e4ba08a70a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:40 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec Sep 28 18:15:40 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:40 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec" returned: 0 in 0.611s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:40 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec Sep 28 18:15:40 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:41 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-033f173e-48d1-4149-9791-9db3c8e894ec" returned: 0 in 0.352s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-quobyte-033f173e-48d1-4149-9791-9db3c8e894ec" released by "delete_volume" :: held 1.081s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Created reservations ['ad48ec41-4adf-4db5-a3ae-80942b33591c', '8071121b-ee6e-4250-bfd1-ab726d82cae2', 'afd4f91a-e181-4279-b13f-16604589e3a5', 'f2dcaa0e-4064-41a8-bb17-e9ee9a3455c4'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:41 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:15:41 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:41 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.449s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Deleted volume successfully. Sep 28 18:15:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f583d081-416d-4300-bb65-16d99d781f23 tempest-SnapshotDependencyTests-117621173 None] Lock "cinder-033f173e-48d1-4149-9791-9db3c8e894ec-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:51 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=7 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:51 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=3,cinder:SELECT=13 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Flow 'volume_create_manager' (73cbef36-d422-454a-afce-c40e906d405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae132e6f-36bf-4e2b-88ca-38c56ea8e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae132e6f-36bf-4e2b-88ca-38c56ea8e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-718610868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1ba2ad-73cd-4a10-a744-a17e30772808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a988908d94bc6b9871312b35b6ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:07Z,use_quota=True,user_id='4949114a0b124771b510a567f93dd103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc9a5c3-0b8d-41af-85d0-b07249ba8f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc9a5c3-0b8d-41af-85d0-b07249ba8f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c368942-9538-4787-a1d8-2241d3b87e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c368942-9538-4787-a1d8-2241d3b87e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad1ba2ad-73cd-4a10-a744-a17e30772808', 'volume_name': 'volume-ad1ba2ad-73cd-4a10-a744-a17e30772808', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc23b5-2ba2-4ed0-98b9-499685f58ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc23b5-2ba2-4ed0-98b9-499685f58ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8553da59-0419-4b3a-916f-944c1209178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:07 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Volume ad1ba2ad-73cd-4a10-a744-a17e30772808: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad1ba2ad-73cd-4a10-a744-a17e30772808', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:16:07 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Trying to clone ad1ba2ad-73cd-4a10-a744-a17e30772808 from image fadc8935-e87d-4b36-9885-050bf1046672 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:16:08 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:16:08 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:16:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f9762a-3a59-4a0b-be9c-247e403a5a77]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:08 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD Sep 28 18:16:08 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:09 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 is fetched for user 4949114a0b124771b510a567f93dd103. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb420f52-1944-4a52-8772-020b787a2596]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:09 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD Sep 28 18:16:09 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:09 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-718610868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1ba2ad-73cd-4a10-a744-a17e30772808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a988908d94bc6b9871312b35b6ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:07Z,use_quota=True,user_id='4949114a0b124771b510a567f93dd103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Creating volume ad1ba2ad-73cd-4a10-a744-a17e30772808 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:09 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:16:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:09 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 1073741824 Sep 28 18:16:09 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:10 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 1073741824" returned: 0 in 0.521s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:10 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 Sep 28 18:16:10 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:10 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808" returned: 0 in 0.277s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Attempting download of fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume ad1ba2ad-73cd-4a10-a744-a17e30772808. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdef6d-1183-4f75-af7e-0814b9600681]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:11 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du Sep 28 18:16:11 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:11 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du" returned: 0 in 0.499s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:11 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du Sep 28 18:16:11 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:11 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du" returned: 1 in 0.381s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fadc8935-e87d-4b36-9885-050bf1046672_03qe30du' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:16:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb2eb10-4fef-409d-bbb9-c771c349e37c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:11 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD Sep 28 18:16:11 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:12 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:12 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] fadc8935-e87d-4b36-9885-050bf1046672 was qcow2, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:16:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:12 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 Sep 28 18:16:12 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Flow 'volume_create_manager' (62c64554-5c03-43ac-8fda-7161ece89a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce9d342-5377-4905-9f7f-cfc532327d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce9d342-5377-4905-9f7f-cfc532327d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1269302218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ded57a8-7a06-4e6d-a45d-2c67020eea11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29bbcac0ec24dadbc06a75a7cb27b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:13Z,use_quota=True,user_id='6c9021103b3c4b0a97e15fe595988e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecccf416-95d8-42ac-9abb-b9e2aa851d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecccf416-95d8-42ac-9abb-b9e2aa851d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d538173b-60b5-4907-be3d-a44073ad342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d538173b-60b5-4907-be3d-a44073ad342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ded57a8-7a06-4e6d-a45d-2c67020eea11', 'volume_name': 'volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5d9013-7ead-4458-a102-7f881b30d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5d9013-7ead-4458-a102-7f881b30d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf83b60-0419-4b6d-8aea-1ae63ca6af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:13 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Volume 9ded57a8-7a06-4e6d-a45d-2c67020eea11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11', 'volume_size': 1} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1269302218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ded57a8-7a06-4e6d-a45d-2c67020eea11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29bbcac0ec24dadbc06a75a7cb27b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:13Z,use_quota=True,user_id='6c9021103b3c4b0a97e15fe595988e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Creating volume 9ded57a8-7a06-4e6d-a45d-2c67020eea11 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:13 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:13 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 1073741824 Sep 28 18:16:13 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:13 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 1073741824" returned: 0 in 0.630s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:14 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 Sep 28 18:16:14 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:14 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11" returned: 0 in 0.358s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf83b60-0419-4b6d-8aea-1ae63ca6af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a1444e-265a-47bc-b5af-e0aeffcdbe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:14 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Volume volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 (9ded57a8-7a06-4e6d-a45d-2c67020eea11): created successfully Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a1444e-265a-47bc-b5af-e0aeffcdbe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Flow 'volume_create_manager' (62c64554-5c03-43ac-8fda-7161ece89a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4d63d044-8aad-4538-afb4-68eb2214ab15 tempest-TestMinimumBasicScenario-2097742734 None] Created volume successfully. Sep 28 18:16:14 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808" returned: 0 in 2.502s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fadc8935-e87d-4b36-9885-050bf1046672_oiw7t9kqdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:16:14 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Converted 112.00 MB image at 44.74 MB/s Sep 28 18:16:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:14 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 1G Sep 28 18:16:14 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:15 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 1G" returned: 0 in 0.381s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Downloaded image fadc8935-e87d-4b36-9885-050bf1046672 ((None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}])) to volume ad1ba2ad-73cd-4a10-a744-a17e30772808 successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Temporary image fadc8935-e87d-4b36-9885-050bf1046672 for user 4949114a0b124771b510a567f93dd103 is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Marking volume ad1ba2ad-73cd-4a10-a744-a17e30772808 as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Copying metadata from image fadc8935-e87d-4b36-9885-050bf1046672 to ad1ba2ad-73cd-4a10-a744-a17e30772808. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Creating volume glance metadata for volume ad1ba2ad-73cd-4a10-a744-a17e30772808 backed by image fadc8935-e87d-4b36-9885-050bf1046672 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8553da59-0419-4b3a-916f-944c1209178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1ba2ad-73cd-4a10-a744-a17e30772808', 'volume_size': 1, 'image_id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fadc8935-e87d-4b36-9885-050bf1046672', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4438c3ab2afa42ea9f8cb7c21fc5f9ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fadc8935-e87d-4b36-9885-050bf1046672', 'created_at': datetime.datetime(2026, 9, 28, 15, 52, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 52, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fadc8935-e87d-4b36-9885-050bf1046672/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772004c8-9e5b-4922-bcd3-2e0f1d22738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:15 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Volume volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 (ad1ba2ad-73cd-4a10-a744-a17e30772808): created successfully Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772004c8-9e5b-4922-bcd3-2e0f1d22738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:15 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Flow 'volume_create_manager' (73cbef36-d422-454a-afce-c40e906d405b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-41decf97-7ca7-46f3-b8dc-381639f07d4d tempest-TestShelveInstance-1916921354 None] Created volume successfully. Sep 28 18:16:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c15b267f-c3d4-4d8e-8259-aadd384e26b2 req-13cf8744-510d-4008-9f48-f004b8263b6c tempest-TestMinimumBasicScenario-2097742734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c15b267f-c3d4-4d8e-8259-aadd384e26b2 req-13cf8744-510d-4008-9f48-f004b8263b6c tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c15b267f-c3d4-4d8e-8259-aadd384e26b2 req-13cf8744-510d-4008-9f48-f004b8263b6c tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c15b267f-c3d4-4d8e-8259-aadd384e26b2 req-13cf8744-510d-4008-9f48-f004b8263b6c tempest-TestMinimumBasicScenario-2097742734 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94805aed-e14e-4f5e-9b4e-066e1e469094', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c15b267f-c3d4-4d8e-8259-aadd384e26b2 req-13cf8744-510d-4008-9f48-f004b8263b6c tempest-TestMinimumBasicScenario-2097742734 None] attachment_update completed successfully. Sep 28 18:16:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-61f24e2a-3b85-4b70-a998-e07e7641ded3 req-58de46e7-b3ad-4f1f-a257-ca89aa9645b0 tempest-TestShelveInstance-1916921354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-61f24e2a-3b85-4b70-a998-e07e7641ded3 req-58de46e7-b3ad-4f1f-a257-ca89aa9645b0 tempest-TestShelveInstance-1916921354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-61f24e2a-3b85-4b70-a998-e07e7641ded3 req-58de46e7-b3ad-4f1f-a257-ca89aa9645b0 tempest-TestShelveInstance-1916921354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-61f24e2a-3b85-4b70-a998-e07e7641ded3 req-58de46e7-b3ad-4f1f-a257-ca89aa9645b0 tempest-TestShelveInstance-1916921354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-ad1ba2ad-73cd-4a10-a744-a17e30772808', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e367c5c0-d788-42cb-8e64-4953507f1b85', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-61f24e2a-3b85-4b70-a998-e07e7641ded3 req-58de46e7-b3ad-4f1f-a257-ca89aa9645b0 tempest-TestShelveInstance-1916921354 None] attachment_update completed successfully. Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:23 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:16:23 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.695s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:16:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:16:29 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=10,cinder:SELECT=24,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:29 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=12 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-7279a3f3-7ed2-47eb-82d7-2ac41a5c4cfe req-8e5b1df3-62d3-4094-9c03-f17bcac6be11 tempest-TestMinimumBasicScenario-2097742734 None] Terminate volume connection completed successfully. Sep 28 18:17:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-7279a3f3-7ed2-47eb-82d7-2ac41a5c4cfe req-8e5b1df3-62d3-4094-9c03-f17bcac6be11 tempest-TestMinimumBasicScenario-2097742734 None] Deleting attachment 94805aed-e14e-4f5e-9b4e-066e1e469094. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:17:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Acquiring lock "cinder-9ded57a8-7a06-4e6d-a45d-2c67020eea11-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Lock "cinder-9ded57a8-7a06-4e6d-a45d-2c67020eea11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Acquiring lock "cinder-quobyte-9ded57a8-7a06-4e6d-a45d-2c67020eea11" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Lock "cinder-quobyte-9ded57a8-7a06-4e6d-a45d-2c67020eea11" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7446a0-0de8-4282-b7d4-3c40631f09c7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:10 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 Sep 28 18:17:10 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:10 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11" returned: 0 in 0.424s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:11 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11 Sep 28 18:17:11 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:11 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ded57a8-7a06-4e6d-a45d-2c67020eea11" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Lock "cinder-quobyte-9ded57a8-7a06-4e6d-a45d-2c67020eea11" released by "delete_volume" :: held 0.764s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Created reservations ['2f178d07-3d8f-465c-9066-792215711297', '9cbdb45e-3463-4423-bf7a-a43312a41350', 'cb08020e-e7f0-4ed4-9d93-b05cf32c5941', 'edff6c65-7422-4cef-90fc-6308b2052172'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:11 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:17:11 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:11 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.390s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Deleted volume successfully. Sep 28 18:17:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c0d0e692-b669-407b-9b23-f5c9ff138087 tempest-TestMinimumBasicScenario-2097742734 None] Lock "cinder-9ded57a8-7a06-4e6d-a45d-2c67020eea11-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:12 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-d42ab8b2-7e23-4aa0-bd5e-697c91b59dd7 req-2e9b9ec7-3bfe-4ddb-85b2-73a9ec0b342d tempest-TestShelveInstance-1916921354 None] Terminate volume connection completed successfully. Sep 28 18:17:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-d42ab8b2-7e23-4aa0-bd5e-697c91b59dd7 req-2e9b9ec7-3bfe-4ddb-85b2-73a9ec0b342d tempest-TestShelveInstance-1916921354 None] Deleting attachment e367c5c0-d788-42cb-8e64-4953507f1b85. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:17:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-02f8364a-465b-446e-b978-02b45e6f02d7 req-c0c43ea2-a416-465e-a8cd-568757f57820 tempest-TestShelveInstance-1916921354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-02f8364a-465b-446e-b978-02b45e6f02d7 req-c0c43ea2-a416-465e-a8cd-568757f57820 tempest-TestShelveInstance-1916921354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-02f8364a-465b-446e-b978-02b45e6f02d7 req-c0c43ea2-a416-465e-a8cd-568757f57820 tempest-TestShelveInstance-1916921354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:16 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-02f8364a-465b-446e-b978-02b45e6f02d7 req-c0c43ea2-a416-465e-a8cd-568757f57820 tempest-TestShelveInstance-1916921354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-ad1ba2ad-73cd-4a10-a744-a17e30772808', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50aa511e-8e51-4883-9f84-59c61464b37f', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:17:16 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-02f8364a-465b-446e-b978-02b45e6f02d7 req-c0c43ea2-a416-465e-a8cd-568757f57820 tempest-TestShelveInstance-1916921354 None] attachment_update completed successfully. Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:23 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:17:23 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:24 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.302s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:17:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:17:26 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:26 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Flow 'volume_create_manager' (81a308b0-624f-4397-b2f0-ec05c000beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202b3ced-c795-48c8-8a90-d026014169a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202b3ced-c795-48c8-8a90-d026014169a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1528717958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a456beb-d155-4310-a8a9-b47ad0ec118f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fdc4d363914184b3161abbdb6b4365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:00Z,use_quota=True,user_id='664b3232d6514897aa4e0829280a00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2e33d7-6839-46ff-912a-685e7265d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2e33d7-6839-46ff-912a-685e7265d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba560db-1b96-4a14-9c37-f986225b762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba560db-1b96-4a14-9c37-f986225b762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a456beb-d155-4310-a8a9-b47ad0ec118f', 'volume_name': 'volume-9a456beb-d155-4310-a8a9-b47ad0ec118f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b7cc23-2924-4844-b6fb-74f203b50394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b7cc23-2924-4844-b6fb-74f203b50394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ccdcf6-bdd2-4cc1-8808-1f3d02682cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Volume 9a456beb-d155-4310-a8a9-b47ad0ec118f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a456beb-d155-4310-a8a9-b47ad0ec118f', 'volume_size': 1} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1528717958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a456beb-d155-4310-a8a9-b47ad0ec118f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fdc4d363914184b3161abbdb6b4365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:00Z,use_quota=True,user_id='664b3232d6514897aa4e0829280a00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Creating volume 9a456beb-d155-4310-a8a9-b47ad0ec118f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:00 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:00 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f 1073741824 Sep 28 18:18:00 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Flow 'volume_create_manager' (561f2520-f966-42eb-86b1-a9667dc4ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d014e6-bfd4-4d39-9093-41069cb100a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d014e6-bfd4-4d39-9093-41069cb100a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-31026351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b75c98-8f80-4db2-ad42-9bd81eca2ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fdc4d363914184b3161abbdb6b4365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:00Z,use_quota=True,user_id='664b3232d6514897aa4e0829280a00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c84bf1-86f6-4e09-84e6-ce51e81005b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c84bf1-86f6-4e09-84e6-ce51e81005b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd425f61-36ff-4a82-9705-76e79bf64ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd425f61-36ff-4a82-9705-76e79bf64ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b75c98-8f80-4db2-ad42-9bd81eca2ee6', 'volume_name': 'volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c5a1dc-bed8-4f35-b486-f0c0cebf97ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c5a1dc-bed8-4f35-b486-f0c0cebf97ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4d88f4-2003-4d62-99ae-a45b4cc6fb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:00 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Volume 51b75c98-8f80-4db2-ad42-9bd81eca2ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6', 'volume_size': 1} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:00 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f 1073741824" returned: 0 in 0.716s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:00 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f Sep 28 18:18:00 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:01 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f" returned: 0 in 0.316s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.604s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-31026351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b75c98-8f80-4db2-ad42-9bd81eca2ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fdc4d363914184b3161abbdb6b4365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:00Z,use_quota=True,user_id='664b3232d6514897aa4e0829280a00b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Creating volume 51b75c98-8f80-4db2-ad42-9bd81eca2ee6 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:01 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ccdcf6-bdd2-4cc1-8808-1f3d02682cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a456beb-d155-4310-a8a9-b47ad0ec118f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29412e8-899e-4d74-a897-d02f042f45d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:01 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 1073741824 Sep 28 18:18:01 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:01 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Volume volume-9a456beb-d155-4310-a8a9-b47ad0ec118f (9a456beb-d155-4310-a8a9-b47ad0ec118f): created successfully Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29412e8-899e-4d74-a897-d02f042f45d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Flow 'volume_create_manager' (81a308b0-624f-4397-b2f0-ec05c000beac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9c8553d4-8864-4a6c-9ff2-9dee49bf4f6a tempest-TestServerVolumeAttachmentScenario-205978401 None] Created volume successfully. Sep 28 18:18:02 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 1073741824" returned: 0 in 0.816s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:02 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 Sep 28 18:18:02 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:02 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6" returned: 0 in 0.496s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4d88f4-2003-4d62-99ae-a45b4cc6fb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839624b2-e49f-4c30-935d-c180cd5b847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:02 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Volume volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 (51b75c98-8f80-4db2-ad42-9bd81eca2ee6): created successfully Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839624b2-e49f-4c30-935d-c180cd5b847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Flow 'volume_create_manager' (561f2520-f966-42eb-86b1-a9667dc4ba78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-869b89ea-10d0-45a7-994b-82f4b9ac5204 tempest-TestServerVolumeAttachmentScenario-205978401 None] Created volume successfully. Sep 28 18:18:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-7116a56a-6ba5-4ce2-8b71-f16c7bd4ae06 tempest-TestShelveInstance-1916921354 None] Terminate volume connection completed successfully. Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-7116a56a-6ba5-4ce2-8b71-f16c7bd4ae06 tempest-TestShelveInstance-1916921354 None] Deleting attachment 50aa511e-8e51-4883-9f84-59c61464b37f. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Acquiring lock "cinder-ad1ba2ad-73cd-4a10-a744-a17e30772808-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Lock "cinder-ad1ba2ad-73cd-4a10-a744-a17e30772808-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Acquiring lock "cinder-quobyte-ad1ba2ad-73cd-4a10-a744-a17e30772808" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Lock "cinder-quobyte-ad1ba2ad-73cd-4a10-a744-a17e30772808" acquired by "delete_volume" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b5d20b-b00b-4ea9-bb04-d91e453e1ba2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:05 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 Sep 28 18:18:05 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:06 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808" returned: 0 in 0.598s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:06 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808 Sep 28 18:18:06 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:06 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-ad1ba2ad-73cd-4a10-a744-a17e30772808" returned: 0 in 0.366s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Lock "cinder-quobyte-ad1ba2ad-73cd-4a10-a744-a17e30772808" released by "delete_volume" :: held 1.058s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG cinder.quota [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Created reservations ['58c7ce48-c10a-486a-9094-14846c924c95', '931edc3c-92d0-4846-8184-3434bdc44adf', '55d95c2c-1837-4894-9ac7-e20a359bb568', 'b3b661dc-428e-4cd0-bde4-952cbafe939e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:06 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:18:06 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:07 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.390s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:07 devstack cinder-volume[87096]: DEBUG cinder.manager [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Deleted volume successfully. Sep 28 18:18:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [req-3c5e7b52-6b30-44a9-ae58-478b34da15a7 req-a68b2ca5-aad8-4b98-921f-7b61387eea15 tempest-TestShelveInstance-1916921354 None] Lock "cinder-ad1ba2ad-73cd-4a10-a744-a17e30772808-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:16 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=11,cinder:UPDATE=17,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:17 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=10,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:23 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:18:23 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:24 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.332s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:18:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:18:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c56128b2-1aab-4dda-a316-6e5892bf01e5 req-a0d5d244-f23d-4329-abe5-d293128d8c9e tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c56128b2-1aab-4dda-a316-6e5892bf01e5 req-a0d5d244-f23d-4329-abe5-d293128d8c9e tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c56128b2-1aab-4dda-a316-6e5892bf01e5 req-a0d5d244-f23d-4329-abe5-d293128d8c9e tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c56128b2-1aab-4dda-a316-6e5892bf01e5 req-a0d5d244-f23d-4329-abe5-d293128d8c9e tempest-TestServerVolumeAttachmentScenario-205978401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-9a456beb-d155-4310-a8a9-b47ad0ec118f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd51fc522-3e8f-42d8-bd50-cb54a9e10191', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:18:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c56128b2-1aab-4dda-a316-6e5892bf01e5 req-a0d5d244-f23d-4329-abe5-d293128d8c9e tempest-TestServerVolumeAttachmentScenario-205978401 None] attachment_update completed successfully. Sep 28 18:18:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c1b3aff2-44ba-4484-9ac9-9c42276d3aa4 req-0b5d5a8f-8348-4266-93e3-7288d114bea4 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c1b3aff2-44ba-4484-9ac9-9c42276d3aa4 req-0b5d5a8f-8348-4266-93e3-7288d114bea4 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c1b3aff2-44ba-4484-9ac9-9c42276d3aa4 req-0b5d5a8f-8348-4266-93e3-7288d114bea4 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c1b3aff2-44ba-4484-9ac9-9c42276d3aa4 req-0b5d5a8f-8348-4266-93e3-7288d114bea4 tempest-TestServerVolumeAttachmentScenario-205978401 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e884384f-663a-4015-a2a6-29dd64b56a24', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:18:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c1b3aff2-44ba-4484-9ac9-9c42276d3aa4 req-0b5d5a8f-8348-4266-93e3-7288d114bea4 tempest-TestServerVolumeAttachmentScenario-205978401 None] attachment_update completed successfully. Sep 28 18:18:47 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-5aec1992-cabe-4957-b7c8-f2e9fa80b4ba req-b6666b22-0cb6-44ce-b163-7e7f4a92632f tempest-TestServerVolumeAttachmentScenario-205978401 None] Terminate volume connection completed successfully. Sep 28 18:18:47 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-5aec1992-cabe-4957-b7c8-f2e9fa80b4ba req-b6666b22-0cb6-44ce-b163-7e7f4a92632f tempest-TestServerVolumeAttachmentScenario-205978401 None] Deleting attachment e884384f-663a-4015-a2a6-29dd64b56a24. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:49 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-564057ec-bee1-4626-8fcb-7d454422dae9 req-026e7353-cd37-4bfa-867f-e2fe82e175e8 tempest-TestServerVolumeAttachmentScenario-205978401 None] Terminate volume connection completed successfully. Sep 28 18:18:49 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-564057ec-bee1-4626-8fcb-7d454422dae9 req-026e7353-cd37-4bfa-867f-e2fe82e175e8 tempest-TestServerVolumeAttachmentScenario-205978401 None] Deleting attachment d51fc522-3e8f-42d8-bd50-cb54a9e10191. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Flow 'volume_create_manager' (ff92f100-b49c-40f6-9ffb-6ff465c99d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ec0431-5b05-4a86-b2ff-f3c4bbd21adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ec0431-5b05-4a86-b2ff-f3c4bbd21adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1650483975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba916d7-7026-401e-8d97-5aa49c3d87fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8febda7e57f434cbc7c7656781a38b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:56Z,use_quota=True,user_id='f563233d9b2b472e9194b041d8397bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169d6dc1-b81e-4264-a6a7-3c316ddb39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169d6dc1-b81e-4264-a6a7-3c316ddb39b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc4ccc-427c-4258-819d-744b7a528f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc4ccc-427c-4258-819d-744b7a528f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba916d7-7026-401e-8d97-5aa49c3d87fe', 'volume_name': 'volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a30ad27-fc01-451a-90e0-668eb9bbbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a30ad27-fc01-451a-90e0-668eb9bbbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f158051d-3cee-4bfd-aef0-afb98696fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Volume 9ba916d7-7026-401e-8d97-5aa49c3d87fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe', 'volume_size': 1} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1650483975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba916d7-7026-401e-8d97-5aa49c3d87fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8febda7e57f434cbc7c7656781a38b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:18:56Z,use_quota=True,user_id='f563233d9b2b472e9194b041d8397bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Creating volume 9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:18:56 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:56 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe 1073741824 Sep 28 18:18:56 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:56 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe 1073741824" returned: 0 in 0.585s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:56 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe Sep 28 18:18:56 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "cinder-51b75c98-8f80-4db2-ad42-9bd81eca2ee6-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-51b75c98-8f80-4db2-ad42-9bd81eca2ee6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "cinder-quobyte-51b75c98-8f80-4db2-ad42-9bd81eca2ee6" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-quobyte-51b75c98-8f80-4db2-ad42-9bd81eca2ee6" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dce544-4dd4-4b95-bf7c-86560ef88833]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:57 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe" returned: 0 in 0.404s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f158051d-3cee-4bfd-aef0-afb98696fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c9af11-9b64-4d8b-8d0b-49bf880bd035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:18:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Volume volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe (9ba916d7-7026-401e-8d97-5aa49c3d87fe): created successfully Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c9af11-9b64-4d8b-8d0b-49bf880bd035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Flow 'volume_create_manager' (ff92f100-b49c-40f6-9ffb-6ff465c99d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:18:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b87e843a-db1a-4bf3-877b-1583402a3c57 tempest-TestImageHashVerification-2145357673 None] Created volume successfully. Sep 28 18:18:57 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 Sep 28 18:18:57 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:57 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6" returned: 0 in 0.428s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:57 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6 Sep 28 18:18:57 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:57 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-51b75c98-8f80-4db2-ad42-9bd81eca2ee6" returned: 0 in 0.289s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-quobyte-51b75c98-8f80-4db2-ad42-9bd81eca2ee6" released by "delete_volume" :: held 0.765s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Created reservations ['4cf40fca-4c5f-4a21-9c1e-79c2b55348f8', '3e6f9285-6782-4834-be53-0e5cf081ad67', '18540244-c142-48b8-9b77-e3c10c55ba41', '4a108947-5e64-41e0-9edf-aad910fc7a62'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:57 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:18:57 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "cinder-9a456beb-d155-4310-a8a9-b47ad0ec118f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-9a456beb-d155-4310-a8a9-b47ad0ec118f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "cinder-quobyte-9a456beb-d155-4310-a8a9-b47ad0ec118f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-quobyte-9a456beb-d155-4310-a8a9-b47ad0ec118f" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6db06-73b3-45c7-b19e-33dabbde4cd5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:58 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Deleted volume successfully. Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cb691f95-ab03-4e4a-8e54-05bff28ef111 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-51b75c98-8f80-4db2-ad42-9bd81eca2ee6-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:58 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f Sep 28 18:18:58 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:58 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f" returned: 0 in 0.449s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:58 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f Sep 28 18:18:58 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:59 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9a456beb-d155-4310-a8a9-b47ad0ec118f" returned: 0 in 0.288s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-quobyte-9a456beb-d155-4310-a8a9-b47ad0ec118f" released by "delete_volume" :: held 0.809s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Created reservations ['4e55b8cb-6cfe-4bc4-984c-3a4d34eb5ee7', 'f7b8b6ed-2cef-4575-96cc-a98a54a3ef02', '785f36af-feef-48fd-83ea-1b021fa77913', '715af3d4-bfb5-40a8-8b31-23a67f1396fc'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e1fcce-e7ce-4683-afca-eeed46fa62a1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:59 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:18:59 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:59 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe Sep 28 18:18:59 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:59 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.326s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Deleted volume successfully. Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-12828a51-41c6-4339-b1ba-fa5b373e4841 tempest-TestServerVolumeAttachmentScenario-205978401 None] Lock "cinder-9a456beb-d155-4310-a8a9-b47ad0ec118f-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:59 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe" returned: 0 in 0.517s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc3951f-87fc-45a9-9a26-fa27c2b90e9a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:59 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe Sep 28 18:18:59 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:00 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe" returned: 0 in 0.463s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe /opt/stack/data/cinder/conversion/9ba916d7-7026-401e-8d97-5aa49c3d87fe.temp_image.c832a72e-6875-4094-b0d3-158c869c7579j8dit89e.img {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:00 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe /opt/stack/data/cinder/conversion/9ba916d7-7026-401e-8d97-5aa49c3d87fe.temp_image.c832a72e-6875-4094-b0d3-158c869c7579j8dit89e.img Sep 28 18:19:00 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe /opt/stack/data/cinder/conversion/9ba916d7-7026-401e-8d97-5aa49c3d87fe.temp_image.c832a72e-6875-4094-b0d3-158c869c7579j8dit89e.img" returned: 0 in 7.607s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00e9729-ef6a-4117-b963-c978adf9fade]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:08 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe Sep 28 18:19:08 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:08 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe" returned: 0 in 0.691s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:08 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/conversion/9ba916d7-7026-401e-8d97-5aa49c3d87fe.temp_image.c832a72e-6875-4094-b0d3-158c869c7579j8dit89e.img {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:19:08 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Converted 1024.00 MB image at 134.55 MB/s Sep 28 18:19:08 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] c832a72e-6875-4094-b0d3-158c869c7579 was raw, no need to convert to raw {{(pid=87096) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (ed0e4f77-203c-4bdf-acfe-f8246a427eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95eb02d-9c39-4c9c-acbf-38a214e86f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95eb02d-9c39-4c9c-acbf-38a214e86f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248511622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d4576-cfb2-41cb-a70d-08fab98fd852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:18Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42202ad8-086c-4635-8195-8e56eefa5657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42202ad8-086c-4635-8195-8e56eefa5657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c71ad88-27ab-4dad-b50b-4671a3f22c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c71ad88-27ab-4dad-b50b-4671a3f22c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5d4576-cfb2-41cb-a70d-08fab98fd852', 'volume_name': 'volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a8dae3-64d7-46a4-b808-ebf9d794a7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a8dae3-64d7-46a4-b808-ebf9d794a7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc34595-3634-4752-8eab-ee7154b639c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:18 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Volume 1c5d4576-cfb2-41cb-a70d-08fab98fd852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852', 'volume_size': 1} Sep 28 18:19:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (31880709-7373-4111-949e-70a8d8d6d29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf7e959-28c6-4f2c-8035-d61321814b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf7e959-28c6-4f2c-8035-d61321814b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440431303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00553d9-e1a0-43cf-ab59-bac26a57d10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:19Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b3c9d8-7622-4ebb-b7b0-40027b743649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b3c9d8-7622-4ebb-b7b0-40027b743649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc9720f-8f2e-47e3-9796-eb643f328cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc9720f-8f2e-47e3-9796-eb643f328cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00553d9-e1a0-43cf-ab59-bac26a57d10d', 'volume_name': 'volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125136d1-d1b9-48dd-b9ee-1574fa0a12e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125136d1-d1b9-48dd-b9ee-1574fa0a12e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc77b2d-09d7-4acc-93c9-eac5eee8af9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Volume c00553d9-e1a0-43cf-ab59-bac26a57d10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d', 'volume_size': 1} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (8514e9ac-e2fa-408d-aed6-d1f30d68c944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aef036e-f648-48c9-8fb7-957b3131532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aef036e-f648-48c9-8fb7-957b3131532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893353473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d5045c-8618-40b2-9ffc-e2b1accd2634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d5045c-8618-40b2-9ffc-e2b1accd2634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a493319-3bb8-43bd-b191-a1e3fcf72547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a493319-3bb8-43bd-b191-a1e3fcf72547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5', 'volume_name': 'volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb512130-529c-44d1-bffb-465e00028571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb512130-529c-44d1-bffb-465e00028571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402907b8-004a-4964-8a08-336d053d576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:19 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Volume d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5', 'volume_size': 1} Sep 28 18:19:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (e58d091a-3401-4677-a360-4dd4003c4467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3414cfe1-6bf3-499e-aa20-c680b668272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3414cfe1-6bf3-499e-aa20-c680b668272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760366408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0befa07-a1d2-4ef5-86b0-81c69e311e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a94670-9f37-4b30-98e0-7d930a7f4760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a94670-9f37-4b30-98e0-7d930a7f4760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4c4d2b-e63e-403c-a390-352181cec786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4c4d2b-e63e-403c-a390-352181cec786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0befa07-a1d2-4ef5-86b0-81c69e311e12', 'volume_name': 'volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae691f2-1efe-483b-86d4-90d83e267b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae691f2-1efe-483b-86d4-90d83e267b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d897ccfc-d3a6-4bb8-acee-03f6fe6e9125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Volume c0befa07-a1d2-4ef5-86b0-81c69e311e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12', 'volume_size': 1} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (2781ea62-f963-4f62-97d4-ca57d429c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3e3b20-9539-4eb5-9e9e-32a5a9150d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3e3b20-9539-4eb5-9e9e-32a5a9150d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967999727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd8f7a8-086e-4b09-85a1-cd4115a53322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:21Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c8321c-f78a-4ad2-acc1-0a741ffec7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c8321c-f78a-4ad2-acc1-0a741ffec7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba1e992-d8e7-4179-b996-2b586070ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba1e992-d8e7-4179-b996-2b586070ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd8f7a8-086e-4b09-85a1-cd4115a53322', 'volume_name': 'volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9f2b92-1258-4fda-9d7d-82fd9cbd3c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9f2b92-1258-4fda-9d7d-82fd9cbd3c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8c739-488c-4d07-a795-6b9ad593ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Volume 3bd8f7a8-086e-4b09-85a1-cd4115a53322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322', 'volume_size': 1} Sep 28 18:19:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:23 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:23 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:24 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.305s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:19:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:19:30 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=38,cinder:UPDATE=21,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:30 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=29,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.403s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Uploaded volume to glance image-id: c832a72e-6875-4094-b0d3-158c869c7579. {{(pid=87096) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.927s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-248511622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d4576-cfb2-41cb-a70d-08fab98fd852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:18Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Creating volume 1c5d4576-cfb2-41cb-a70d-08fab98fd852 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:32 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:19:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:32 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 1073741824 Sep 28 18:19:32 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5baaa911-8c0b-429e-b1f5-bb1032da58bb tempest-TestImageHashVerification-2145357673 None] Copy volume to image completed successfully. Sep 28 18:19:33 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 1073741824" returned: 0 in 0.579s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:33 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 Sep 28 18:19:33 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Acquiring lock "cinder-9ba916d7-7026-401e-8d97-5aa49c3d87fe-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Lock "cinder-9ba916d7-7026-401e-8d97-5aa49c3d87fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:33 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852" returned: 0 in 0.410s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.464s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440431303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00553d9-e1a0-43cf-ab59-bac26a57d10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:19Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Creating volume c00553d9-e1a0-43cf-ab59-bac26a57d10d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:33 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Acquiring lock "cinder-quobyte-9ba916d7-7026-401e-8d97-5aa49c3d87fe" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:33 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d 1073741824 Sep 28 18:19:33 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc34595-3634-4752-8eab-ee7154b639c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6445c410-6147-4d96-9520-7ac2bde999b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Lock "cinder-quobyte-9ba916d7-7026-401e-8d97-5aa49c3d87fe" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d3f5f9-4253-4c21-a276-8b69dd5badd0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Volume volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 (1c5d4576-cfb2-41cb-a70d-08fab98fd852): created successfully Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6445c410-6147-4d96-9520-7ac2bde999b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (ed0e4f77-203c-4bdf-acfe-f8246a427eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3dab7e99-e66e-4a6d-8bda-c53c17664906 tempest-CreateVolumesFromImageTest-1594733936 None] Created volume successfully. Sep 28 18:19:33 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe Sep 28 18:19:33 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d 1073741824" returned: 0 in 0.532s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d Sep 28 18:19:34 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe Sep 28 18:19:34 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.813s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893353473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Creating volume d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:34 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9ba916d7-7026-401e-8d97-5aa49c3d87fe" returned: 0 in 0.327s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:34 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 1073741824 Sep 28 18:19:34 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Lock "cinder-quobyte-9ba916d7-7026-401e-8d97-5aa49c3d87fe" released by "delete_volume" :: held 0.889s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc77b2d-09d7-4acc-93c9-eac5eee8af9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fba9a19-a546-45cb-8f09-1339e923e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Volume volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d (c00553d9-e1a0-43cf-ab59-bac26a57d10d): created successfully Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fba9a19-a546-45cb-8f09-1339e923e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (31880709-7373-4111-949e-70a8d8d6d29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-950079b2-5b71-4917-be54-5198850045d8 tempest-CreateVolumesFromImageTest-1594733936 None] Created volume successfully. Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Created reservations ['07f79184-b4e2-4e2f-91e1-2cf566d77171', '1947f225-42ae-4bdb-bcb2-14a94601a592', '53ec9f3f-66da-4ada-b420-41f757ef0341', '569f5f3e-873c-406e-ae4f-8eb956ab773d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:34 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:34 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:35 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 1073741824" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:35 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.328s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Deleted volume successfully. Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-df1d1e51-033b-4c9b-9f34-01b210bbd104 tempest-TestImageHashVerification-2145357673 None] Lock "cinder-9ba916d7-7026-401e-8d97-5aa49c3d87fe-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:35 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 Sep 28 18:19:35 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:35 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5" returned: 0 in 0.311s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.227s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760366408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0befa07-a1d2-4ef5-86b0-81c69e311e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Creating volume c0befa07-a1d2-4ef5-86b0-81c69e311e12 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:35 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402907b8-004a-4964-8a08-336d053d576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 1073741824 Sep 28 18:19:35 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1129ee7-588c-4506-974f-d3ba54b501b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Volume volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 (d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5): created successfully Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1129ee7-588c-4506-974f-d3ba54b501b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (8514e9ac-e2fa-408d-aed6-d1f30d68c944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e6a9b9ae-66a4-43d0-bcd5-900b34827011 tempest-CreateVolumesFromImageTest-1594733936 None] Created volume successfully. Sep 28 18:19:36 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 1073741824" returned: 0 in 0.608s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:36 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 Sep 28 18:19:36 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:36 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12" returned: 0 in 0.282s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.647s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967999727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd8f7a8-086e-4b09-85a1-cd4115a53322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51064f5bfa2c46faa74a58712b0e2fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:21Z,use_quota=True,user_id='c421df47ddfe48108ee1e9926b3020bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Creating volume 3bd8f7a8-086e-4b09-85a1-cd4115a53322 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:36 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:36 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 1073741824 Sep 28 18:19:36 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d897ccfc-d3a6-4bb8-acee-03f6fe6e9125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80206ac6-92ae-4ce3-9f1d-c9e4dd02331e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Volume volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 (c0befa07-a1d2-4ef5-86b0-81c69e311e12): created successfully Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80206ac6-92ae-4ce3-9f1d-c9e4dd02331e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (e58d091a-3401-4677-a360-4dd4003c4467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-455739d2-44ce-4495-8563-7cbe2b14f3c8 tempest-CreateVolumesFromImageTest-1594733936 None] Created volume successfully. Sep 28 18:19:37 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 1073741824" returned: 0 in 0.632s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:37 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 Sep 28 18:19:37 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:37 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322" returned: 0 in 0.345s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8c739-488c-4d07-a795-6b9ad593ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196aa6b1-aba9-4db5-b9c5-e308cbc9bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Volume volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 (3bd8f7a8-086e-4b09-85a1-cd4115a53322): created successfully Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196aa6b1-aba9-4db5-b9c5-e308cbc9bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Flow 'volume_create_manager' (2781ea62-f963-4f62-97d4-ca57d429c198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-0abea12f-b754-4802-92ac-b06a9f58566f tempest-CreateVolumesFromImageTest-1594733936 None] Created volume successfully. Sep 28 18:19:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-3bd8f7a8-086e-4b09-85a1-cd4115a53322-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-3bd8f7a8-086e-4b09-85a1-cd4115a53322-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-quobyte-3bd8f7a8-086e-4b09-85a1-cd4115a53322" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-3bd8f7a8-086e-4b09-85a1-cd4115a53322" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:38 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3670f7bd-b40f-48dd-866a-8c310b439c11]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:38 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 Sep 28 18:19:38 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322" returned: 0 in 0.481s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:39 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322 Sep 28 18:19:39 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3bd8f7a8-086e-4b09-85a1-cd4115a53322" returned: 0 in 0.302s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-3bd8f7a8-086e-4b09-85a1-cd4115a53322" released by "delete_volume" :: held 0.843s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Created reservations ['285b37da-11eb-435c-9fab-24b65d0b6e9c', '51f4233e-9928-4cf8-bbc9-d897db9d8a5e', '67c09794-4d90-4b96-87f7-d417fe9aded8', 'a890d2d9-157a-4d16-8e0a-b7382b64c190'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:39 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:39 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-c0befa07-a1d2-4ef5-86b0-81c69e311e12-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-c0befa07-a1d2-4ef5-86b0-81c69e311e12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-quobyte-c0befa07-a1d2-4ef5-86b0-81c69e311e12" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-c0befa07-a1d2-4ef5-86b0-81c69e311e12" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb8a432-8207-4a23-812a-20971309bfd9]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:40 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.467s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:40 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Deleted volume successfully. Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e2dcc8a7-31b1-4c59-8266-eac06b3da429 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-3bd8f7a8-086e-4b09-85a1-cd4115a53322-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:40 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12" returned: 0 in 0.474s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:40 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12 Sep 28 18:19:40 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:40 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c0befa07-a1d2-4ef5-86b0-81c69e311e12" returned: 0 in 0.321s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-c0befa07-a1d2-4ef5-86b0-81c69e311e12" released by "delete_volume" :: held 0.868s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Created reservations ['e12bf846-5d58-408d-a508-49b6bafb2bf1', 'cb95fbd9-88ef-4801-a673-a01ae80e3977', '275445fb-bac5-4eb5-ac15-64a0f39aca81', '654d4b84-253a-48c1-8d4c-f3b22de4509e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:41 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-quobyte-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cee287-0f8a-452d-b278-bd5a7629e977]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.337s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Deleted volume successfully. Sep 28 18:19:41 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 Sep 28 18:19:41 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-60d580bd-d3ef-460a-9c4a-fc0cf8e48b69 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-c0befa07-a1d2-4ef5-86b0-81c69e311e12-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:41 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5" returned: 0 in 0.547s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:41 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5 Sep 28 18:19:41 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:42 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5" released by "delete_volume" :: held 0.964s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Created reservations ['afae1fe2-d492-4d88-ab59-3318e20df5cc', '54b3b8ea-4863-4e47-b338-c3f9bc7b0867', '5cd649f3-8f83-4c5e-a847-d59b7bab8182', '50f0a77f-d9f8-4817-828b-41a23df32792'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:42 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:42 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:42 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Deleted volume successfully. Sep 28 18:19:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a0c2e-f27c-460b-bb51-0ee702cdcf1d tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-d3a4ac48-06c3-4bb7-87c9-aaf881ab1fc5-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-c00553d9-e1a0-43cf-ab59-bac26a57d10d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-c00553d9-e1a0-43cf-ab59-bac26a57d10d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-quobyte-c00553d9-e1a0-43cf-ab59-bac26a57d10d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-c00553d9-e1a0-43cf-ab59-bac26a57d10d" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886c74f-509f-4d0d-baad-30e6b96e0dd2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:43 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d Sep 28 18:19:43 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:43 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:44 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d Sep 28 18:19:44 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:44 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c00553d9-e1a0-43cf-ab59-bac26a57d10d" returned: 0 in 0.294s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-c00553d9-e1a0-43cf-ab59-bac26a57d10d" released by "delete_volume" :: held 0.833s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Created reservations ['b19d6b38-e7ae-41a5-9ee9-e7175bbc40e7', '7c3e2ef9-e7fb-4d00-93ab-2e4515cc4211', 'c8b49b77-f742-4252-a521-3925944ef745', 'cc99c698-8afe-4aca-8d3d-b1afd49f525b'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:44 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:44 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-1c5d4576-cfb2-41cb-a70d-08fab98fd852-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-1c5d4576-cfb2-41cb-a70d-08fab98fd852-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "cinder-quobyte-1c5d4576-cfb2-41cb-a70d-08fab98fd852" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-1c5d4576-cfb2-41cb-a70d-08fab98fd852" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b304fa1f-b097-4376-9023-b1bdca62f101]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:44 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.411s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:44 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 Sep 28 18:19:44 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:44 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Deleted volume successfully. Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-161b4fb2-3915-4e64-9caa-c500f8ec4082 tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-c00553d9-e1a0-43cf-ab59-bac26a57d10d-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:45 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852 Sep 28 18:19:45 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:45 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c5d4576-cfb2-41cb-a70d-08fab98fd852" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-quobyte-1c5d4576-cfb2-41cb-a70d-08fab98fd852" released by "delete_volume" :: held 0.861s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Created reservations ['713ccd85-bdda-4e9f-bc53-5cd0a36cebcd', '87682d76-a21a-4264-b89d-ebbe5dfa777c', 'e5b8844a-be8e-4d61-9339-7c70022848d9', 'a283bad8-09bb-44cd-acc3-b50162291f38'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:45 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:19:45 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:46 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.367s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:46 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Deleted volume successfully. Sep 28 18:19:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-18c62847-c4de-4bf1-b240-ec97ea14c43c tempest-CreateVolumesFromImageTest-1594733936 None] Lock "cinder-1c5d4576-cfb2-41cb-a70d-08fab98fd852-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:55 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=38,cinder:UPDATE=58,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:56 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=64,cinder:SELECT=33,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:07 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:23 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:20:23 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.372s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:20:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Flow 'volume_create_manager' (4f92a41a-1f81-4e50-9564-dc447a963df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d56e26-073b-418f-b0eb-5cf71ede3ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d56e26-073b-418f-b0eb-5cf71ede3ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-612725944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bf6dd4-b528-4147-98b4-2db13c62e9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a0bf64746345c38b2d00e3dcf9de27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:26Z,use_quota=True,user_id='73909379ee9a4ad493dad6e850fc4906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b95b2-7fac-4f4d-b874-6c7351b74aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b95b2-7fac-4f4d-b874-6c7351b74aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3ac3ca-67de-4196-9a7f-1179fc39aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3ac3ca-67de-4196-9a7f-1179fc39aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bf6dd4-b528-4147-98b4-2db13c62e9c3', 'volume_name': 'volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a8408e-1eab-4fa3-8931-babc3615dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a8408e-1eab-4fa3-8931-babc3615dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d208d4-b5c2-45b9-a746-bf35b7817767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:25 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Volume 97bf6dd4-b528-4147-98b4-2db13c62e9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3', 'volume_size': 1} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-612725944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bf6dd4-b528-4147-98b4-2db13c62e9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a0bf64746345c38b2d00e3dcf9de27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:26Z,use_quota=True,user_id='73909379ee9a4ad493dad6e850fc4906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Creating volume 97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:25 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:20:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:25 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 1073741824 Sep 28 18:20:25 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:26 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 1073741824" returned: 0 in 0.568s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:26 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 Sep 28 18:20:26 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:26 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3" returned: 0 in 0.343s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d208d4-b5c2-45b9-a746-bf35b7817767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a6229b-908a-46d9-88f8-800e56273e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:26 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Volume volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 (97bf6dd4-b528-4147-98b4-2db13c62e9c3): created successfully Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a6229b-908a-46d9-88f8-800e56273e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:26 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Flow 'volume_create_manager' (4f92a41a-1f81-4e50-9564-dc447a963df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f8785780-f4ba-4f46-b556-00ec88e54bea tempest-TestStampPattern-1680964428 None] Created volume successfully. Sep 28 18:20:36 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:36 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-36e63678-64ac-412a-9397-391307b92ee8 req-4871e609-a7fd-48da-9240-7da6199b3296 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-36e63678-64ac-412a-9397-391307b92ee8 req-4871e609-a7fd-48da-9240-7da6199b3296 tempest-TestStampPattern-1680964428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-36e63678-64ac-412a-9397-391307b92ee8 req-4871e609-a7fd-48da-9240-7da6199b3296 tempest-TestStampPattern-1680964428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-36e63678-64ac-412a-9397-391307b92ee8 req-4871e609-a7fd-48da-9240-7da6199b3296 tempest-TestStampPattern-1680964428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97ac8784-dc47-44fb-8116-6cf176b413c5', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:20:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-36e63678-64ac-412a-9397-391307b92ee8 req-4871e609-a7fd-48da-9240-7da6199b3296 tempest-TestStampPattern-1680964428 None] attachment_update completed successfully. Sep 28 18:21:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-e8a49196-4f2f-4164-8c29-b6321f14cde4 req-5a1b8311-0f27-4735-bb1d-f77c54947439 tempest-TestStampPattern-1680964428 None] Terminate volume connection completed successfully. Sep 28 18:21:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-e8a49196-4f2f-4164-8c29-b6321f14cde4 req-5a1b8311-0f27-4735-bb1d-f77c54947439 tempest-TestStampPattern-1680964428 None] Deleting attachment 97ac8784-dc47-44fb-8116-6cf176b413c5. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:21:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Creating offline snapshot bb3cc05a-5254-42ac-9dcf-e58a2a669e88 of volume 97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a81a1-5f41-440b-baf5-487b06de03f4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 Sep 28 18:21:06 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3" returned: 0 in 0.476s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 1G Sep 28 18:21:06 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 1G" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 Sep 28 18:21:07 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88" returned: 0 in 0.341s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 is being set with open permissions: ugo+rw Sep 28 18:21:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 Sep 28 18:21:07 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88" returned: 0 in 0.294s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info Sep 28 18:21:07 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info" returned: 0 in 0.280s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info is being set with open permissions: ugo+rw Sep 28 18:21:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info Sep 28 18:21:07 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.info" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-95305076-d7c1-44bc-8a56-33ce57e2f197 tempest-TestStampPattern-1680964428 None] Create snapshot completed successfully Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Flow 'volume_create_manager' (60da2272-d8a6-4bd4-88f7-fd41d841acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68429640-4311-480c-9225-ac69b6c61cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68429640-4311-480c-9225-ac69b6c61cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-291319685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029aaac3-8cba-4999-afcb-29a2eb57cd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a0bf64746345c38b2d00e3dcf9de27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb3cc05a-5254-42ac-9dcf-e58a2a669e88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:17Z,use_quota=True,user_id='73909379ee9a4ad493dad6e850fc4906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e66c9ae-7988-4053-9701-481cd1b72fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e66c9ae-7988-4053-9701-481cd1b72fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51d5b99-c866-4ca7-aede-3c100c4e8ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51d5b99-c866-4ca7-aede-3c100c4e8ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '029aaac3-8cba-4999-afcb-29a2eb57cd47', 'volume_name': 'volume-029aaac3-8cba-4999-afcb-29a2eb57cd47', 'volume_size': 1, 'snapshot_id': 'bb3cc05a-5254-42ac-9dcf-e58a2a669e88'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82d2d72-79ae-434c-8e0a-928caf23e645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82d2d72-79ae-434c-8e0a-928caf23e645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eb2317-3e64-4a8d-9ad4-251415b18f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:17 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Volume 029aaac3-8cba-4999-afcb-29a2eb57cd47: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-029aaac3-8cba-4999-afcb-29a2eb57cd47', 'volume_size': 1, 'snapshot_id': 'bb3cc05a-5254-42ac-9dcf-e58a2a669e88'} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-quobyte-bb3cc05a-5254-42ac-9dcf-e58a2a669e88-029aaac3-8cba-4999-afcb-29a2eb57cd47" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-bb3cc05a-5254-42ac-9dcf-e58a2a669e88-029aaac3-8cba-4999-afcb-29a2eb57cd47" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Creating volume 029aaac3-8cba-4999-afcb-29a2eb57cd47 from snapshot bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-quobyte-029aaac3-8cba-4999-afcb-29a2eb57cd47" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-029aaac3-8cba-4999-afcb-29a2eb57cd47" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] snapshot: bb3cc05a-5254-42ac-9dcf-e58a2a669e88, volume: 029aaac3-8cba-4999-afcb-29a2eb57cd47, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[79130966-caf4-42d3-9c0e-8092abbbea6a]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:17 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 Sep 28 18:21:17 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:17 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88" returned: 0 in 0.458s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4510f-34a3-4840-a54e-2ec6d23cb406]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:18 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 Sep 28 18:21:18 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:18 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3" returned: 0 in 0.442s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:21:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:21:18 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:21:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:18 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 Sep 28 18:21:18 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:21:23 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.710s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:21:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:21:27 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:27 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:27 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47" returned: 0 in 9.208s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3, size 1024.00 MB, duration 9.21 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:21:27 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Converted 1024.00 MB image at 111.19 MB/s Sep 28 18:21:27 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 is being set with open permissions: ugo+rw Sep 28 18:21:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 Sep 28 18:21:27 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47" returned: 0 in 0.355s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-029aaac3-8cba-4999-afcb-29a2eb57cd47" released by "_copy_volume_from_snapshot" :: held 10.608s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-bb3cc05a-5254-42ac-9dcf-e58a2a669e88-029aaac3-8cba-4999-afcb-29a2eb57cd47" released by "_create_volume_from_snapshot" :: held 10.712s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.733s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eb2317-3e64-4a8d-9ad4-251415b18f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029aaac3-8cba-4999-afcb-29a2eb57cd47', 'volume_size': 1, 'snapshot_id': 'bb3cc05a-5254-42ac-9dcf-e58a2a669e88'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7646262a-13ce-4935-a3e0-7bec3ea6e41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:28 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Volume volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 (029aaac3-8cba-4999-afcb-29a2eb57cd47): created successfully Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7646262a-13ce-4935-a3e0-7bec3ea6e41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Flow 'volume_create_manager' (60da2272-d8a6-4bd4-88f7-fd41d841acb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:28 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a28acc8c-026c-48f5-bfb2-62f616102f37 tempest-TestStampPattern-1680964428 None] Created volume successfully. Sep 28 18:21:38 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:38 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c7c68904-8254-402d-a1b4-283099815853 req-bda1b7d0-c6a3-4f93-997e-080729ae5784 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c7c68904-8254-402d-a1b4-283099815853 req-bda1b7d0-c6a3-4f93-997e-080729ae5784 tempest-TestStampPattern-1680964428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [req-c7c68904-8254-402d-a1b4-283099815853 req-bda1b7d0-c6a3-4f93-997e-080729ae5784 tempest-TestStampPattern-1680964428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-c7c68904-8254-402d-a1b4-283099815853 req-bda1b7d0-c6a3-4f93-997e-080729ae5784 tempest-TestStampPattern-1680964428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e', 'name': 'volume-029aaac3-8cba-4999-afcb-29a2eb57cd47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57735920-b6cb-42b9-ab6e-83c5cbeb335c', 'enforce_multipath': True} {{(pid=87096) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:21:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-c7c68904-8254-402d-a1b4-283099815853 req-bda1b7d0-c6a3-4f93-997e-080729ae5784 tempest-TestStampPattern-1680964428 None] attachment_update completed successfully. Sep 28 18:22:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [req-7ff6b6e6-c71e-4967-aff8-aa4da6c0a51b req-078dad74-64b6-40e5-830d-33e495ad6c65 tempest-TestStampPattern-1680964428 None] Terminate volume connection completed successfully. Sep 28 18:22:02 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [req-7ff6b6e6-c71e-4967-aff8-aa4da6c0a51b req-078dad74-64b6-40e5-830d-33e495ad6c65 tempest-TestStampPattern-1680964428 None] Deleting attachment 57735920-b6cb-42b9-ab6e-83c5cbeb335c. {{(pid=87096) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:22:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-029aaac3-8cba-4999-afcb-29a2eb57cd47-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Lock "cinder-029aaac3-8cba-4999-afcb-29a2eb57cd47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-quobyte-029aaac3-8cba-4999-afcb-29a2eb57cd47" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-029aaac3-8cba-4999-afcb-29a2eb57cd47" acquired by "delete_volume" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ba3e40-4b3b-4486-bedb-90082a400252]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 Sep 28 18:22:06 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47" returned: 0 in 0.378s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47 Sep 28 18:22:07 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-029aaac3-8cba-4999-afcb-29a2eb57cd47" returned: 0 in 0.258s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-029aaac3-8cba-4999-afcb-29a2eb57cd47" released by "delete_volume" :: held 0.683s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Created reservations ['e8d03091-0451-4cbf-a2ae-bdea96e99e85', 'c3e82119-aeb0-4376-ad18-c3b4bcf62b61', 'bcbcfb90-d203-4af0-b644-0c6a05e0fe32', 'c279fe6b-6ece-47af-be2e-3323f2e4e37a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:07 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.346s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Deleted volume successfully. Sep 28 18:22:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c9b55c7-28e7-4af9-a906-b9b3a83043b3 tempest-TestStampPattern-1680964428 None] Lock "cinder-029aaac3-8cba-4999-afcb-29a2eb57cd47-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-bb3cc05a-5254-42ac-9dcf-e58a2a669e88-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Lock "cinder-bb3cc05a-5254-42ac-9dcf-e58a2a669e88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-quobyte-97bf6dd4-b528-4147-98b4-2db13c62e9c3" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-97bf6dd4-b528-4147-98b4-2db13c62e9c3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-quobyte-bb3cc05a-5254-42ac-9dcf-e58a2a669e88" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-bb3cc05a-5254-42ac-9dcf-e58a2a669e88" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Deleting offline snapshot bb3cc05a-5254-42ac-9dcf-e58a2a669e88 of volume 97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] snapshot_file for this snap is: volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c03dc-480f-4b75-b43a-3c8f3b5de24e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 Sep 28 18:22:08 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:08 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88" returned: 0 in 0.397s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[07978f62-1dd4-4755-b3a4-2be31af82a1e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 Sep 28 18:22:08 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:09 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3" returned: 0 in 0.605s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:09 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 Sep 28 18:22:09 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:09 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88" returned: 0 in 0.360s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:09 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88 Sep 28 18:22:09 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:09 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3.bb3cc05a-5254-42ac-9dcf-e58a2a669e88" returned: 0 in 0.262s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-bb3cc05a-5254-42ac-9dcf-e58a2a669e88" released by "_delete_snapshot" :: held 1.742s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-97bf6dd4-b528-4147-98b4-2db13c62e9c3" released by "delete_snapshot" :: held 1.769s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:10 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Created reservations ['ff6d750b-db8d-44a6-8fbd-be7efcdee0bf', '25fda517-0cbf-48f5-adab-fbfef84f7e61', '8f570f33-8ac1-48af-a208-ec3730eb7acb', 'e47787bc-608e-4513-9855-1edc6e26e417'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Delete snapshot completed successfully. Sep 28 18:22:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a8559838-1613-4363-8ced-9af7c93ffaac tempest-TestStampPattern-1680964428 None] Lock "cinder-bb3cc05a-5254-42ac-9dcf-e58a2a669e88-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-97bf6dd4-b528-4147-98b4-2db13c62e9c3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Lock "cinder-97bf6dd4-b528-4147-98b4-2db13c62e9c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Acquiring lock "cinder-quobyte-97bf6dd4-b528-4147-98b4-2db13c62e9c3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-97bf6dd4-b528-4147-98b4-2db13c62e9c3" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e4c53e-03f3-4c1c-b1a4-85308bc79e80]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 Sep 28 18:22:14 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:14 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3" returned: 0 in 0.427s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3 Sep 28 18:22:14 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:15 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-97bf6dd4-b528-4147-98b4-2db13c62e9c3" returned: 0 in 0.278s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Lock "cinder-quobyte-97bf6dd4-b528-4147-98b4-2db13c62e9c3" released by "delete_volume" :: held 0.791s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Created reservations ['71f977d9-7048-4cf4-8875-26908e1c0cee', '3bda52f6-99a5-46f4-a91b-05d1f2cb942d', '71666000-bb03-4ad9-99e1-d39515c4597e', '35fc346b-da67-4d51-9a8f-b0db443c6174'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:15 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:15 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:15 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.294s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Deleted volume successfully. Sep 28 18:22:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-b326b42d-d510-4344-8ff3-47c567a2de68 tempest-TestStampPattern-1680964428 None] Lock "cinder-97bf6dd4-b528-4147-98b4-2db13c62e9c3-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:23 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:23 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:24 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.347s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:22:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:22:25 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:25 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=24,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (66615470-42fc-46e0-94ae-4477f5ee1eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744d73ef-025d-459b-9d98-e2d8242fce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744d73ef-025d-459b-9d98-e2d8242fce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937670127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c911fdd2-4ce3-420f-8c48-977d340e1afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:31Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f44e5a-2ddf-43a9-9ade-a0267181f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f44e5a-2ddf-43a9-9ade-a0267181f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34ef1c9-9ae0-4a80-8ff2-0a40c300fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34ef1c9-9ae0-4a80-8ff2-0a40c300fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c911fdd2-4ce3-420f-8c48-977d340e1afa', 'volume_name': 'volume-c911fdd2-4ce3-420f-8c48-977d340e1afa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d8953a-561a-49c4-96b6-9e27a5694b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d8953a-561a-49c4-96b6-9e27a5694b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a92b16a-749c-42de-bf1a-3f95e78cff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:31 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume c911fdd2-4ce3-420f-8c48-977d340e1afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c911fdd2-4ce3-420f-8c48-977d340e1afa', 'volume_size': 1} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937670127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c911fdd2-4ce3-420f-8c48-977d340e1afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:31Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Creating volume c911fdd2-4ce3-420f-8c48-977d340e1afa {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:31 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:31 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa 1073741824 Sep 28 18:22:31 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:32 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa 1073741824" returned: 0 in 0.478s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:32 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa Sep 28 18:22:32 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:32 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa" returned: 0 in 0.302s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a92b16a-749c-42de-bf1a-3f95e78cff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c911fdd2-4ce3-420f-8c48-977d340e1afa', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd815c8d-cee7-454f-9c99-9c00871097be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:32 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume volume-c911fdd2-4ce3-420f-8c48-977d340e1afa (c911fdd2-4ce3-420f-8c48-977d340e1afa): created successfully Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd815c8d-cee7-454f-9c99-9c00871097be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (66615470-42fc-46e0-94ae-4477f5ee1eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4bd53afb-2caf-41ed-ab69-32c3d7c3ec6d tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created volume successfully. Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (65a4eecb-6871-4b98-a34b-c68dadfe5394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9923922d-4f42-4bcf-bb28-3476d5ab6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9923922d-4f42-4bcf-bb28-3476d5ab6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129315036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeec3f06-cd97-4fc8-9364-4b81f9e74e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:34Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f68882-37a8-488d-888f-82776ea46760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f68882-37a8-488d-888f-82776ea46760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd54af7c-6a4f-4ea9-80a3-104c24d9a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd54af7c-6a4f-4ea9-80a3-104c24d9a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeec3f06-cd97-4fc8-9364-4b81f9e74e25', 'volume_name': 'volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3796d48-3be9-4837-aed6-cbb2a339cc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3796d48-3be9-4837-aed6-cbb2a339cc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad50e6-93fa-4da7-acde-00d5bd8ea570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume aeec3f06-cd97-4fc8-9364-4b81f9e74e25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25', 'volume_size': 1} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1129315036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeec3f06-cd97-4fc8-9364-4b81f9e74e25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:34Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Creating volume aeec3f06-cd97-4fc8-9364-4b81f9e74e25 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:34 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:34 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 1073741824 Sep 28 18:22:34 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (2f0c451d-611f-4155-80fb-a7730b18b3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcfe854-8c9c-4d29-bda9-021756585595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcfe854-8c9c-4d29-bda9-021756585595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396649842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0059d02-479d-4e95-be38-3f2098064d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:35Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7879c516-dafe-4c0a-a983-f3857b50a54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7879c516-dafe-4c0a-a983-f3857b50a54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71faf517-2da9-4aea-b305-9b4429923645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71faf517-2da9-4aea-b305-9b4429923645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0059d02-479d-4e95-be38-3f2098064d5f', 'volume_name': 'volume-a0059d02-479d-4e95-be38-3f2098064d5f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8251627-e223-4ebe-bc78-94ba737af66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8251627-e223-4ebe-bc78-94ba737af66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e27b180-49a1-415f-a9bf-dfab3d5e6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume a0059d02-479d-4e95-be38-3f2098064d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0059d02-479d-4e95-be38-3f2098064d5f', 'volume_size': 1} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:34 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 1073741824" returned: 0 in 0.626s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:34 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 Sep 28 18:22:34 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (a052ebfa-0b90-4f3e-974a-db811b6c9ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:35 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8746af8-eb77-4068-b730-def988a1489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25" returned: 0 in 0.316s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396649842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0059d02-479d-4e95-be38-3f2098064d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:35Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Creating volume a0059d02-479d-4e95-be38-3f2098064d5f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:35 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8746af8-eb77-4068-b730-def988a1489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20236855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cad22e1-54c7-43a4-8801-695c979063c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:35Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99d9693-f714-4acf-9597-1c72de4fde33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f 1073741824 Sep 28 18:22:35 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99d9693-f714-4acf-9597-1c72de4fde33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9606ed17-cc46-46d3-be2b-ee837b55a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9606ed17-cc46-46d3-be2b-ee837b55a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cad22e1-54c7-43a4-8801-695c979063c3', 'volume_name': 'volume-9cad22e1-54c7-43a4-8801-695c979063c3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1dd7cf-33f1-480b-94f0-d52010cd9611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1dd7cf-33f1-480b-94f0-d52010cd9611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05e5740-4395-4115-a0d0-fe76242cab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume 9cad22e1-54c7-43a4-8801-695c979063c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cad22e1-54c7-43a4-8801-695c979063c3', 'volume_size': 1} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad50e6-93fa-4da7-acde-00d5bd8ea570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5d229e-892b-42a4-a1d5-5240b67d11b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 (aeec3f06-cd97-4fc8-9364-4b81f9e74e25): created successfully Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5d229e-892b-42a4-a1d5-5240b67d11b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (65a4eecb-6871-4b98-a34b-c68dadfe5394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f81485da-ba36-423b-9956-39f8075abf54 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created volume successfully. Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (5790f681-587a-478e-b7ac-9c3d00ae1dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8ab243-6109-4b8b-840d-04911e1f2aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8ab243-6109-4b8b-840d-04911e1f2aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-675620204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f1b6fa-31bb-4014-8998-607af11f36d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:36Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2286dca2-89b0-43c2-8503-f39ca08edb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2286dca2-89b0-43c2-8503-f39ca08edb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c49df05-aa8e-438a-8b74-54cebecac143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c49df05-aa8e-438a-8b74-54cebecac143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f1b6fa-31bb-4014-8998-607af11f36d7', 'volume_name': 'volume-24f1b6fa-31bb-4014-8998-607af11f36d7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a86722-b9ed-43d3-a651-b6139e81eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a86722-b9ed-43d3-a651-b6139e81eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7eca46-55ae-4293-9e08-a0a916fdce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume 24f1b6fa-31bb-4014-8998-607af11f36d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f1b6fa-31bb-4014-8998-607af11f36d7', 'volume_size': 1} Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:35 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f 1073741824" returned: 0 in 0.728s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:36 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f Sep 28 18:22:36 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (a138050f-1cf2-4408-a3b7-492d3114148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13fd96b-213d-4d26-80c0-7caa08bfb138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13fd96b-213d-4d26-80c0-7caa08bfb138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1271491132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40fd7d5-4178-40c1-83c4-265c9efd676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:36Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d07a4f0-2cde-4649-a5da-4f927ade6a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d07a4f0-2cde-4649-a5da-4f927ade6a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5721eef-fa0b-4391-b6c6-ae584d4f3934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5721eef-fa0b-4391-b6c6-ae584d4f3934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40fd7d5-4178-40c1-83c4-265c9efd676c', 'volume_name': 'volume-e40fd7d5-4178-40c1-83c4-265c9efd676c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a342b9-f52b-4b15-b1be-8cd15acbd23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a342b9-f52b-4b15-b1be-8cd15acbd23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeb70a8-ee85-4523-8308-4f1b9fa6dfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume e40fd7d5-4178-40c1-83c4-265c9efd676c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40fd7d5-4178-40c1-83c4-265c9efd676c', 'volume_size': 1} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:36 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20236855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cad22e1-54c7-43a4-8801-695c979063c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:35Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Creating volume 9cad22e1-54c7-43a4-8801-695c979063c3 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:36 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e27b180-49a1-415f-a9bf-dfab3d5e6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0059d02-479d-4e95-be38-3f2098064d5f', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:36 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 1073741824 Sep 28 18:22:36 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f371965b-44b5-46f1-a2c8-a8b0a2f53374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume volume-a0059d02-479d-4e95-be38-3f2098064d5f (a0059d02-479d-4e95-be38-3f2098064d5f): created successfully Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f371965b-44b5-46f1-a2c8-a8b0a2f53374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (2f0c451d-611f-4155-80fb-a7730b18b3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2117ef24-60ef-49ef-994e-b58385f0261c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created volume successfully. Sep 28 18:22:36 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 1073741824" returned: 0 in 0.510s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:36 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 Sep 28 18:22:36 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:37 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3" returned: 0 in 0.325s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-675620204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f1b6fa-31bb-4014-8998-607af11f36d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:36Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Creating volume 24f1b6fa-31bb-4014-8998-607af11f36d7 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05e5740-4395-4115-a0d0-fe76242cab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cad22e1-54c7-43a4-8801-695c979063c3', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:37 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 1073741824 Sep 28 18:22:37 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf4242d-aaa6-47ce-aac0-12207f0ec2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume volume-9cad22e1-54c7-43a4-8801-695c979063c3 (9cad22e1-54c7-43a4-8801-695c979063c3): created successfully Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf4242d-aaa6-47ce-aac0-12207f0ec2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (a052ebfa-0b90-4f3e-974a-db811b6c9ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-acf3ce77-81e3-45de-82cd-f04290ab7e5c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created volume successfully. Sep 28 18:22:37 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 1073741824" returned: 0 in 0.519s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:37 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 Sep 28 18:22:37 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:38 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7" returned: 0 in 0.325s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.877s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1271491132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e40fd7d5-4178-40c1-83c4-265c9efd676c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ac12330bf94c6cac35e246221fe210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:36Z,use_quota=True,user_id='426934c07f3d4761ac31fc05224bfd06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Creating volume e40fd7d5-4178-40c1-83c4-265c9efd676c {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:38 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7eca46-55ae-4293-9e08-a0a916fdce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f1b6fa-31bb-4014-8998-607af11f36d7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2edad49-8762-4a69-8d15-ba034027b5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:38 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c 1073741824 Sep 28 18:22:38 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:38 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume volume-24f1b6fa-31bb-4014-8998-607af11f36d7 (24f1b6fa-31bb-4014-8998-607af11f36d7): created successfully Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2edad49-8762-4a69-8d15-ba034027b5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (5790f681-587a-478e-b7ac-9c3d00ae1dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a232754f-f1f1-4b09-8d7d-b2940f3e0b07 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created volume successfully. Sep 28 18:22:38 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c 1073741824" returned: 0 in 0.529s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:38 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c Sep 28 18:22:38 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:38 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c" returned: 0 in 0.282s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeb70a8-ee85-4523-8308-4f1b9fa6dfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40fd7d5-4178-40c1-83c4-265c9efd676c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9911d0e-3469-4f53-b37a-5df069c4a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Volume volume-e40fd7d5-4178-40c1-83c4-265c9efd676c (e40fd7d5-4178-40c1-83c4-265c9efd676c): created successfully Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9911d0e-3469-4f53-b37a-5df069c4a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Flow 'volume_create_manager' (a138050f-1cf2-4408-a3b7-492d3114148d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-afe35fef-d642-4523-9478-313b3ef4b69b tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created volume successfully. Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-e40fd7d5-4178-40c1-83c4-265c9efd676c-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-e40fd7d5-4178-40c1-83c4-265c9efd676c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-quobyte-e40fd7d5-4178-40c1-83c4-265c9efd676c" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-e40fd7d5-4178-40c1-83c4-265c9efd676c" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[664126e0-4bad-4876-9130-2f58681727a3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:39 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c Sep 28 18:22:39 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:40 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c" returned: 0 in 0.411s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:40 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c Sep 28 18:22:40 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:40 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e40fd7d5-4178-40c1-83c4-265c9efd676c" returned: 0 in 0.255s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-e40fd7d5-4178-40c1-83c4-265c9efd676c" released by "delete_volume" :: held 0.712s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created reservations ['565c2043-e648-4dc0-aa52-18f9143f7c40', '7d5bf226-83df-4241-b377-a23834bf0eea', '9135a9ec-2df2-49dc-baad-83db89b44948', '79bc2537-8839-43a7-b6ff-24d60d45f90c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:40 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:40 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-24f1b6fa-31bb-4014-8998-607af11f36d7-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-24f1b6fa-31bb-4014-8998-607af11f36d7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:40 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Deleted volume successfully. Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-quobyte-24f1b6fa-31bb-4014-8998-607af11f36d7" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7112f9e-59d7-4c08-8524-ce5daee0d56c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-e40fd7d5-4178-40c1-83c4-265c9efd676c-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-24f1b6fa-31bb-4014-8998-607af11f36d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1de8bdd-aac8-4fd3-a198-b3c79e658dcb]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:41 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 Sep 28 18:22:41 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:41 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7" returned: 0 in 0.378s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:41 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7 Sep 28 18:22:41 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:41 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-24f1b6fa-31bb-4014-8998-607af11f36d7" returned: 0 in 0.285s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-24f1b6fa-31bb-4014-8998-607af11f36d7" released by "delete_volume" :: held 0.706s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created reservations ['907d1ac2-edc4-4d9c-b3c0-fd3d70764e49', 'd386f7a6-ea9e-4bf9-ab02-1dad477f9199', '09aa366a-bd3b-45ca-8afb-7ebff92c9650', '2f92fe44-dca1-45a0-8364-c30cb1988806'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:41 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:41 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-9cad22e1-54c7-43a4-8801-695c979063c3-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-9cad22e1-54c7-43a4-8801-695c979063c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:42 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.298s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Deleted volume successfully. Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-quobyte-9cad22e1-54c7-43a4-8801-695c979063c3" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-9cad22e1-54c7-43a4-8801-695c979063c3" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ddafde2-893c-4b70-901e-6eeb44eec313 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-24f1b6fa-31bb-4014-8998-607af11f36d7-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d39643-bca6-4083-9577-e5647186522b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 Sep 28 18:22:42 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3" returned: 0 in 0.405s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3 Sep 28 18:22:42 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:42 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9cad22e1-54c7-43a4-8801-695c979063c3" returned: 0 in 0.277s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-9cad22e1-54c7-43a4-8801-695c979063c3" released by "delete_volume" :: held 0.728s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created reservations ['89b905bc-6da1-4945-bc4d-77118f0fdc39', 'c93a4242-aa67-408f-bfb9-107eb8dc327d', 'dc6409a3-6bc0-4134-a527-e83d5f33f385', 'fcf66ce7-cbe5-450a-8e76-c5cfd0a4f942'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:42 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:42 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-a0059d02-479d-4e95-be38-3f2098064d5f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-a0059d02-479d-4e95-be38-3f2098064d5f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:43 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.321s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-quobyte-a0059d02-479d-4e95-be38-3f2098064d5f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Deleted volume successfully. Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-a0059d02-479d-4e95-be38-3f2098064d5f" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1320bf6c-b87e-45fe-b760-c2410883ad6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-9cad22e1-54c7-43a4-8801-695c979063c3-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262b76d-572d-491b-b6ce-c632d74bac9d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:43 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f Sep 28 18:22:43 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:43 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f" returned: 0 in 0.447s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:43 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f Sep 28 18:22:43 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a0059d02-479d-4e95-be38-3f2098064d5f" returned: 0 in 0.276s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-a0059d02-479d-4e95-be38-3f2098064d5f" released by "delete_volume" :: held 0.779s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created reservations ['d985da70-11d6-42a1-ab8e-62fd82064388', '48f5bc02-8ab6-4fba-b1d2-40cea2a02c8c', 'e87da857-be64-43a7-9818-fb6952cb1fed', '0b21ecc2-abdb-4a1b-9363-baa0b389da53'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:44 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-aeec3f06-cd97-4fc8-9364-4b81f9e74e25-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-aeec3f06-cd97-4fc8-9364-4b81f9e74e25-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-quobyte-aeec3f06-cd97-4fc8-9364-4b81f9e74e25" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-aeec3f06-cd97-4fc8-9364-4b81f9e74e25" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:44 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.295s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Deleted volume successfully. Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5043491f-9e71-4f81-876f-52a75070b8b6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6fba053-a460-40f6-b704-ef1827e048af tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-a0059d02-479d-4e95-be38-3f2098064d5f-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:44 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 Sep 28 18:22:44 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:44 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:44 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25 Sep 28 18:22:44 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:45 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-aeec3f06-cd97-4fc8-9364-4b81f9e74e25" returned: 0 in 0.262s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-aeec3f06-cd97-4fc8-9364-4b81f9e74e25" released by "delete_volume" :: held 0.700s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created reservations ['d0803157-2101-43ff-b45e-08acf88aa7d6', '842e60de-a3b1-4bf6-a60b-3a7db29154d5', 'bb2f0d5b-a96d-443b-b4ae-c4f57126501e', '779142b0-269f-4684-ba0c-211680a73310'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:45 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:45 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:45 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-c911fdd2-4ce3-420f-8c48-977d340e1afa-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.278s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Deleted volume successfully. Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-c911fdd2-4ce3-420f-8c48-977d340e1afa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7dee098c-d383-49a2-b56b-1a1037810d6c tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-aeec3f06-cd97-4fc8-9364-4b81f9e74e25-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "cinder-quobyte-c911fdd2-4ce3-420f-8c48-977d340e1afa" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-c911fdd2-4ce3-420f-8c48-977d340e1afa" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc4cea4-0692-4a17-83d7-ac28967be3a3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:45 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa Sep 28 18:22:45 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:46 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa" returned: 0 in 0.408s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:46 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa Sep 28 18:22:46 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:46 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c911fdd2-4ce3-420f-8c48-977d340e1afa" returned: 0 in 0.278s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-quobyte-c911fdd2-4ce3-420f-8c48-977d340e1afa" released by "delete_volume" :: held 0.732s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Created reservations ['a4b187d1-1201-4a86-b21e-b156d54bd58b', 'b5fa6cd3-25f1-4d11-945d-2953dddd04d3', '2d3d7845-015b-4b02-b8e6-e57381786042', 'd5bca258-76ed-42b5-8b50-636cbbfaa7a8'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:46 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:46 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:46 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.285s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Deleted volume successfully. Sep 28 18:22:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-596887c7-15b2-43d3-8af4-8b5cb971b529 tempest-CreateVolumesFromSourceVolumeTest-67568678 None] Lock "cinder-c911fdd2-4ce3-420f-8c48-977d340e1afa-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Flow 'volume_create_manager' (51e13baf-b535-4ef0-a679-e61226dcebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0deb3d-8c1a-4f9b-b4c9-a2f4db6ec53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0deb3d-8c1a-4f9b-b4c9-a2f4db6ec53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5db2dfb-bc81-4692-818c-9bbb47dd6e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9657534d6d4206a6aede13560b12d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:52Z,use_quota=True,user_id='585aaaa45c9e4b9896b4ded07917d5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f48bbc7-fdfb-49cd-a4a7-d85e611c0758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f48bbc7-fdfb-49cd-a4a7-d85e611c0758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227007e5-fbc6-4440-bf90-575b388767d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:22:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227007e5-fbc6-4440-bf90-575b388767d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5db2dfb-bc81-4692-818c-9bbb47dd6e5b', 'volume_name': 'volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b', 'volume_size': 1, 'image_id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd96b9-43f4-43b0-9b16-fc720c515731', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c6d0eecee2cb2a03c01c4e8b7fbb4cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b9657534d6d4206a6aede13560b12d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5aa5a4d208136ae29d072040d48bb4e817ad9a946a96e7e95c9f41ca015a13718c9d42dfa0bc4e2059e0965d3ee03e6561f2dee220cb7f143c29537cd7388e34', 'id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'created_at': datetime.datetime(2026, 9, 28, 16, 22, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 22, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd96b9-43f4-43b0-9b16-fc720c515731/file', 'properties': {}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4362c47f-f5cc-4282-ad2c-08a9eff3b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4362c47f-f5cc-4282-ad2c-08a9eff3b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a618e637-e2a0-46dd-b467-aa24812f0ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Volume e5db2dfb-bc81-4692-818c-9bbb47dd6e5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b', 'volume_size': 1, 'image_id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd96b9-43f4-43b0-9b16-fc720c515731', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c6d0eecee2cb2a03c01c4e8b7fbb4cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b9657534d6d4206a6aede13560b12d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5aa5a4d208136ae29d072040d48bb4e817ad9a946a96e7e95c9f41ca015a13718c9d42dfa0bc4e2059e0965d3ee03e6561f2dee220cb7f143c29537cd7388e34', 'id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'created_at': datetime.datetime(2026, 9, 28, 16, 22, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 22, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd96b9-43f4-43b0-9b16-fc720c515731/file', 'properties': {}}, 'image_service': } Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Trying to clone e5db2dfb-bc81-4692-818c-9bbb47dd6e5b from image bdbd96b9-43f4-43b0-9b16-fc720c515731 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd96b9-43f4-43b0-9b16-fc720c515731', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:22:53 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944956a-a59e-4e76-89ad-1dda104a0071]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:53 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD Sep 28 18:22:53 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:53 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD Sep 28 18:22:53 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:53 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Temporary image bdbd96b9-43f4-43b0-9b16-fc720c515731 is fetched for user 585aaaa45c9e4b9896b4ded07917d5eb. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8029a3-6acb-4dce-aa89-2b04832d99ee]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:54 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD Sep 28 18:22:54 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:54 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:54 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD Sep 28 18:22:54 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:54 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5db2dfb-bc81-4692-818c-9bbb47dd6e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9657534d6d4206a6aede13560b12d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:52Z,use_quota=True,user_id='585aaaa45c9e4b9896b4ded07917d5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Creating volume e5db2dfb-bc81-4692-818c-9bbb47dd6e5b {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:54 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:22:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:54 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b 1073741824 Sep 28 18:22:54 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:55 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b 1073741824" returned: 0 in 0.478s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:55 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b Sep 28 18:22:55 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:55 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" returned: 0 in 0.260s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Attempting download of bdbd96b9-43f4-43b0-9b16-fc720c515731 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd96b9-43f4-43b0-9b16-fc720c515731', 'metadata': {}}])) to volume e5db2dfb-bc81-4692-818c-9bbb47dd6e5b. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[97130d05-bf4b-437c-84ae-01b48ba8f302]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:55 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd Sep 28 18:22:55 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:55 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd" returned: 0 in 0.345s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:56 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd Sep 28 18:22:56 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:56 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd" returned: 1 in 0.400s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbd96b9-43f4-43b0-9b16-fc720c515731_46aag8sd' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a2b281-c1df-4f08-a95a-021f733a9121]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:56 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD Sep 28 18:22:56 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:56 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:56 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD Sep 28 18:22:56 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:57 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] bdbd96b9-43f4-43b0-9b16-fc720c515731 was raw, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:57 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b Sep 28 18:22:57 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:57 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" returned: 0 in 0.509s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbd96b9-43f4-43b0-9b16-fc720c515731_7kj9g79odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:22:57 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:22:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:57 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b 1G Sep 28 18:22:57 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:58 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b 1G" returned: 0 in 0.383s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Downloaded image bdbd96b9-43f4-43b0-9b16-fc720c515731 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbd96b9-43f4-43b0-9b16-fc720c515731', 'metadata': {}}])) to volume e5db2dfb-bc81-4692-818c-9bbb47dd6e5b successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Temporary image bdbd96b9-43f4-43b0-9b16-fc720c515731 for user 585aaaa45c9e4b9896b4ded07917d5eb is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Marking volume e5db2dfb-bc81-4692-818c-9bbb47dd6e5b as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Copying metadata from image bdbd96b9-43f4-43b0-9b16-fc720c515731 to e5db2dfb-bc81-4692-818c-9bbb47dd6e5b. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Creating volume glance metadata for volume e5db2dfb-bc81-4692-818c-9bbb47dd6e5b backed by image bdbd96b9-43f4-43b0-9b16-fc720c515731 with: {'image_id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c6d0eecee2cb2a03c01c4e8b7fbb4cb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a618e637-e2a0-46dd-b467-aa24812f0ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b', 'volume_size': 1, 'image_id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbd96b9-43f4-43b0-9b16-fc720c515731', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c6d0eecee2cb2a03c01c4e8b7fbb4cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b9657534d6d4206a6aede13560b12d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5aa5a4d208136ae29d072040d48bb4e817ad9a946a96e7e95c9f41ca015a13718c9d42dfa0bc4e2059e0965d3ee03e6561f2dee220cb7f143c29537cd7388e34', 'id': 'bdbd96b9-43f4-43b0-9b16-fc720c515731', 'created_at': datetime.datetime(2026, 9, 28, 16, 22, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 22, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbd96b9-43f4-43b0-9b16-fc720c515731/file', 'properties': {}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799953d3-e548-41a5-84f1-add262408ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:58 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Volume volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b (e5db2dfb-bc81-4692-818c-9bbb47dd6e5b): created successfully Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799953d3-e548-41a5-84f1-add262408ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Flow 'volume_create_manager' (51e13baf-b535-4ef0-a679-e61226dcebd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e2e81e3d-e0fd-4b4d-b069-3e51dd45b166 tempest-VolumeImageDependencyTests-89691297 None] Created volume successfully. Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Acquiring lock "cinder-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Lock "cinder-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Acquiring lock "cinder-quobyte-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Lock "cinder-quobyte-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf61e110-ed5e-41b1-b048-b3a6266747c7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b Sep 28 18:22:59 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" returned: 0 in 0.431s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b Sep 28 18:22:59 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:59 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" returned: 0 in 0.285s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Lock "cinder-quobyte-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b" released by "delete_volume" :: held 0.763s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Created reservations ['7fa8f6f5-b69a-4418-8990-371e7d3eac8d', '0fea94ea-ca03-42b1-a286-60fd56ef3043', 'fd7b4e7d-a128-443a-afa8-b78f6441761a', '5bf87682-cc60-4a70-920b-cbbcd60df970'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:59 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:22:59 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:00 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:00 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Deleted volume successfully. Sep 28 18:23:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0a57a26-4135-4552-b059-372e95a1ab4e tempest-VolumeImageDependencyTests-89691297 None] Lock "cinder-e5db2dfb-bc81-4692-818c-9bbb47dd6e5b-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Flow 'volume_create_manager' (89da4ca9-3627-4cdc-8948-d2ad8dc83920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0904960a-104a-4464-b1f7-a6661b3537d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0904960a-104a-4464-b1f7-a6661b3537d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989716940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cba2481-c0da-41c3-af27-654060e3ad31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820d6c99308447e3b387f0919df3e2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:04Z,use_quota=True,user_id='29d199b066444d0ab0809037db309219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fca0168-c1d8-4633-bc8d-a29a0b580171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fca0168-c1d8-4633-bc8d-a29a0b580171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1557bf1e-b29a-424a-be3e-d962d78adac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1557bf1e-b29a-424a-be3e-d962d78adac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cba2481-c0da-41c3-af27-654060e3ad31', 'volume_name': 'volume-6cba2481-c0da-41c3-af27-654060e3ad31', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20b2fb6-5855-4573-8ef8-94bd2079050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20b2fb6-5855-4573-8ef8-94bd2079050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25326d5a-a264-4a43-bb78-08df6ce52173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:04 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Volume 6cba2481-c0da-41c3-af27-654060e3ad31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cba2481-c0da-41c3-af27-654060e3ad31', 'volume_size': 1} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-989716940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cba2481-c0da-41c3-af27-654060e3ad31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820d6c99308447e3b387f0919df3e2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:04Z,use_quota=True,user_id='29d199b066444d0ab0809037db309219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Creating volume 6cba2481-c0da-41c3-af27-654060e3ad31 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:04 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:04 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 1073741824 Sep 28 18:23:04 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:05 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 1073741824" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:05 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 Sep 28 18:23:05 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:05 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31" returned: 0 in 0.247s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25326d5a-a264-4a43-bb78-08df6ce52173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cba2481-c0da-41c3-af27-654060e3ad31', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d53de9-1387-47db-a47a-967989bd8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Volume volume-6cba2481-c0da-41c3-af27-654060e3ad31 (6cba2481-c0da-41c3-af27-654060e3ad31): created successfully Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d53de9-1387-47db-a47a-967989bd8718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Flow 'volume_create_manager' (89da4ca9-3627-4cdc-8948-d2ad8dc83920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-00be98cf-ae2e-4e43-b415-75afc497588f tempest-ProjectReaderTests-6084129 None] Created volume successfully. Sep 28 18:23:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Acquiring lock "cinder-6cba2481-c0da-41c3-af27-654060e3ad31-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Lock "cinder-6cba2481-c0da-41c3-af27-654060e3ad31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Acquiring lock "cinder-quobyte-6cba2481-c0da-41c3-af27-654060e3ad31" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Lock "cinder-quobyte-6cba2481-c0da-41c3-af27-654060e3ad31" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f7726-f3d2-4338-9472-47ad9358b3ca]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:06 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 Sep 28 18:23:06 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:07 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:07 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31 Sep 28 18:23:07 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:07 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6cba2481-c0da-41c3-af27-654060e3ad31" returned: 0 in 0.317s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Lock "cinder-quobyte-6cba2481-c0da-41c3-af27-654060e3ad31" released by "delete_volume" :: held 0.806s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Created reservations ['0dd7d94b-f609-4351-9564-4c78f9dd2bbe', '26afa41d-7d79-442e-8e78-47b86f120983', '0ada33fe-dbe3-4ae4-a434-b6e9636a7cb4', 'b5e0ce82-120a-4852-adf0-73a8798012d9'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:07 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:07 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:08 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.298s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Deleted volume successfully. Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-514e3ddd-1952-44a3-bf30-6e6914d09f32 tempest-ProjectReaderTests-6084129 None] Lock "cinder-6cba2481-c0da-41c3-af27-654060e3ad31-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Flow 'volume_create_manager' (940f6989-b864-4dda-8026-92ece65ffb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3b2c38-ed35-4706-8ea2-c990ce2eea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3b2c38-ed35-4706-8ea2-c990ce2eea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-644486991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36daa1d-18fc-4a24-b987-ab3581da593d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820d6c99308447e3b387f0919df3e2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:08Z,use_quota=True,user_id='29d199b066444d0ab0809037db309219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f972320-b948-4fd4-813b-0f771bbf85de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f972320-b948-4fd4-813b-0f771bbf85de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f51da3-5f54-40a0-965e-4536b3540ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f51da3-5f54-40a0-965e-4536b3540ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36daa1d-18fc-4a24-b987-ab3581da593d', 'volume_name': 'volume-b36daa1d-18fc-4a24-b987-ab3581da593d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba2bef9-7edc-4c83-8223-ed0b79ce9279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba2bef9-7edc-4c83-8223-ed0b79ce9279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1e86a8-7492-4bf3-a89d-d705be7f7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:08 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Volume b36daa1d-18fc-4a24-b987-ab3581da593d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36daa1d-18fc-4a24-b987-ab3581da593d', 'volume_size': 1} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-644486991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36daa1d-18fc-4a24-b987-ab3581da593d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820d6c99308447e3b387f0919df3e2bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:08Z,use_quota=True,user_id='29d199b066444d0ab0809037db309219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Creating volume b36daa1d-18fc-4a24-b987-ab3581da593d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:08 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:08 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d 1073741824 Sep 28 18:23:08 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:09 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d 1073741824" returned: 0 in 0.476s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:09 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d Sep 28 18:23:09 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:09 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1e86a8-7492-4bf3-a89d-d705be7f7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36daa1d-18fc-4a24-b987-ab3581da593d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f78fd5c-de5b-473c-abfe-6f9171f4fc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Volume volume-b36daa1d-18fc-4a24-b987-ab3581da593d (b36daa1d-18fc-4a24-b987-ab3581da593d): created successfully Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f78fd5c-de5b-473c-abfe-6f9171f4fc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Flow 'volume_create_manager' (940f6989-b864-4dda-8026-92ece65ffb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4ba9c63e-a0c7-4eae-a7b4-500ab293572e tempest-ProjectReaderTests-6084129 None] Created volume successfully. Sep 28 18:23:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Acquiring lock "cinder-b36daa1d-18fc-4a24-b987-ab3581da593d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Lock "cinder-b36daa1d-18fc-4a24-b987-ab3581da593d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Acquiring lock "cinder-quobyte-b36daa1d-18fc-4a24-b987-ab3581da593d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Lock "cinder-quobyte-b36daa1d-18fc-4a24-b987-ab3581da593d" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d50b2e0-f2a3-402c-9e60-543809614765]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:10 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d Sep 28 18:23:10 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d" returned: 0 in 0.444s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:11 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d Sep 28 18:23:11 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b36daa1d-18fc-4a24-b987-ab3581da593d" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Lock "cinder-quobyte-b36daa1d-18fc-4a24-b987-ab3581da593d" released by "delete_volume" :: held 0.780s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Created reservations ['f976a864-822b-4f9d-80f5-a123bb66cc1f', 'fa1d8a0a-96d1-4f63-a598-35d51591772d', '3b9912fe-9bd7-4378-94cf-e06d655966d7', 'b74c6431-f848-4995-acd4-db3712840955'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:11 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:11 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:11 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.310s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:11 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Deleted volume successfully. Sep 28 18:23:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d0f494c3-953e-4f6f-8ecc-2e8636b34faa tempest-ProjectReaderTests-6084129 None] Lock "cinder-b36daa1d-18fc-4a24-b987-ab3581da593d-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:21 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=71,cinder:UPDATE=87,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:21 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=66,cinder:UPDATE=114,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:23 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:23 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:23 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.266s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:23 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:23:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:23:31 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (dcae7fa4-969a-486f-b3da-7d9934f48acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80eb3a8b-f2ab-475c-aae2-71474ff61157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80eb3a8b-f2ab-475c-aae2-71474ff61157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21032220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08ae222-ecc3-4836-aa65-ce2b46d5645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:32Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd12d84-5cbc-49c0-a64b-ce1be56df6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd12d84-5cbc-49c0-a64b-ce1be56df6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10211471-b3a0-4354-ac31-308faa0a8156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10211471-b3a0-4354-ac31-308faa0a8156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08ae222-ecc3-4836-aa65-ce2b46d5645d', 'volume_name': 'volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f43be-a3d9-46d9-b7cd-41ff7710afea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f43be-a3d9-46d9-b7cd-41ff7710afea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34e9f3c-5e82-4437-88ab-893405546ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Volume a08ae222-ecc3-4836-aa65-ce2b46d5645d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d', 'volume_size': 1} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21032220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08ae222-ecc3-4836-aa65-ce2b46d5645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:32Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Creating volume a08ae222-ecc3-4836-aa65-ce2b46d5645d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:32 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:32 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d 1073741824 Sep 28 18:23:32 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (bfe38cd9-fdd3-442b-afe2-42148217e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db09665-1771-4223-b372-4f636b775430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db09665-1771-4223-b372-4f636b775430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236278491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2976ea6-2c3f-4521-9c08-8b80fc4de7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:32Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ec79cd-459b-4b5f-adf7-ac3cd37ca6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ec79cd-459b-4b5f-adf7-ac3cd37ca6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc44af32-2cfb-452c-8331-c69a2576cc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc44af32-2cfb-452c-8331-c69a2576cc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2976ea6-2c3f-4521-9c08-8b80fc4de7ad', 'volume_name': 'volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2bd706-2780-4f53-acae-9a143749716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2bd706-2780-4f53-acae-9a143749716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f3e4e2-b934-4a6b-9b2d-c79cff2a8589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume f2976ea6-2c3f-4521-9c08-8b80fc4de7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad', 'volume_size': 1} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (b68a64b1-7e83-497e-bcc3-59cf1b7625f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a26626-bc72-4bb0-b51c-f3649aa83081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a26626-bc72-4bb0-b51c-f3649aa83081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1692438072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af47a76-017d-4f56-b4bc-1d62c0c7b808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:33Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d291692f-2b13-4364-a251-96bd6c604e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d291692f-2b13-4364-a251-96bd6c604e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c40d8b-3ad5-4d56-96e5-74a981f118a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c40d8b-3ad5-4d56-96e5-74a981f118a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af47a76-017d-4f56-b4bc-1d62c0c7b808', 'volume_name': 'volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b489b0b-3d1b-4af4-b8de-05f9996d5663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b489b0b-3d1b-4af4-b8de-05f9996d5663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f84dde-2610-494f-9ba7-14fe41b0716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:32 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Volume 0af47a76-017d-4f56-b4bc-1d62c0c7b808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808', 'volume_size': 1} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:32 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:33 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (5f574bc0-417d-4b6d-859c-0d09b158187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c20255d-3ff9-40aa-b1a5-958b2bd3c805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d 1073741824" returned: 0 in 0.941s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c20255d-3ff9-40aa-b1a5-958b2bd3c805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730508466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ab16cd-e04f-49e9-8e2c-2dc012f17c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:33Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ac2b6b-8d14-4500-9280-47dca1725d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ac2b6b-8d14-4500-9280-47dca1725d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b00bd0-f55d-43be-b709-6d20c076ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b00bd0-f55d-43be-b709-6d20c076ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ab16cd-e04f-49e9-8e2c-2dc012f17c98', 'volume_name': 'volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ff136-0ec4-4ceb-b946-93d62c44905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ff136-0ec4-4ceb-b946-93d62c44905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe355cf3-9fe6-4973-b5ef-138c696440e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume c3ab16cd-e04f-49e9-8e2c-2dc012f17c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98', 'volume_size': 1} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (aa20a198-a917-4b9d-b232-320c0cf0e4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181565d4-7565-4ed9-ab95-b42760aeac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181565d4-7565-4ed9-ab95-b42760aeac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356259128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1102822-f419-4fb2-84ad-b5a7cd9f2fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:33Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4cc7b5-7e52-4e2a-8371-c7b073260156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d Sep 28 18:23:33 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4cc7b5-7e52-4e2a-8371-c7b073260156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac883e-e2f9-42ff-b23e-4f82d2ec05b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ac883e-e2f9-42ff-b23e-4f82d2ec05b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1102822-f419-4fb2-84ad-b5a7cd9f2fc4', 'volume_name': 'volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0691e7a3-8d22-463d-bf31-4a939a15d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0691e7a3-8d22-463d-bf31-4a939a15d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ba8e37-580c-40e4-8e5f-8083665e2aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Volume a1102822-f419-4fb2-84ad-b5a7cd9f2fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4', 'volume_size': 1} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:33 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (38ca11d5-9402-4f9e-955d-009aad7b8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b6db9-2a12-44b4-b0f5-ea11e179291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d" returned: 0 in 0.512s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236278491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2976ea6-2c3f-4521-9c08-8b80fc4de7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:32Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Creating volume f2976ea6-2c3f-4521-9c08-8b80fc4de7ad {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:33 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b6db9-2a12-44b4-b0f5-ea11e179291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424131274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd47c97-ccff-443f-b9d9-b62d9e66bb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:34Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4687eb4-8795-41af-a855-a92cfd97e734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4687eb4-8795-41af-a855-a92cfd97e734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad 1073741824 Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c173d2-ef79-4c39-bfca-8c271c21f46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c173d2-ef79-4c39-bfca-8c271c21f46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd47c97-ccff-443f-b9d9-b62d9e66bb23', 'volume_name': 'volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0594ac7e-ae3e-4231-a0e5-bd8ac7754257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0594ac7e-ae3e-4231-a0e5-bd8ac7754257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2121eb76-8759-4cb2-aa79-704a2070db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Volume abd47c97-ccff-443f-b9d9-b62d9e66bb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23', 'volume_size': 1} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34e9f3c-5e82-4437-88ab-893405546ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:33 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25f0dd7-80ca-4337-84f8-fc267cbe2fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:33 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Volume volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d (a08ae222-ecc3-4836-aa65-ce2b46d5645d): created successfully Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25f0dd7-80ca-4337-84f8-fc267cbe2fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (dcae7fa4-969a-486f-b3da-7d9934f48acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c3bc3c28-8261-4d01-8bc9-7ecfa0433b95 tempest-CreateVolumesFromImageTest-274725864 None] Created volume successfully. Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (da24c678-a8c5-4f3d-9381-4d48a067d82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d870c0-1697-42ca-ab84-696801427fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d870c0-1697-42ca-ab84-696801427fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370435441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5b38f9-3bf7-46ee-a284-57638a0d5b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:34Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa720fc-b657-4e12-b152-2088b526784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa720fc-b657-4e12-b152-2088b526784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7d041d-9cc8-43ec-9db5-68f1a49616ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7d041d-9cc8-43ec-9db5-68f1a49616ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5b38f9-3bf7-46ee-a284-57638a0d5b99', 'volume_name': 'volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab86433c-2e9a-491a-8884-dd8394bc86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab86433c-2e9a-491a-8884-dd8394bc86e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695df73e-5a00-405c-8235-a66e9fb4c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:34 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Volume 8a5b38f9-3bf7-46ee-a284-57638a0d5b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99', 'volume_size': 1} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:34 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad 1073741824" returned: 0 in 0.818s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:34 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad Sep 28 18:23:34 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:35 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad" returned: 0 in 0.324s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1692438072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af47a76-017d-4f56-b4bc-1d62c0c7b808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:33Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Creating volume 0af47a76-017d-4f56-b4bc-1d62c0c7b808 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:35 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f3e4e2-b934-4a6b-9b2d-c79cff2a8589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ceadd0-6cc4-442d-b2b1-39dd8a92f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:35 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 1073741824 Sep 28 18:23:35 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad (f2976ea6-2c3f-4521-9c08-8b80fc4de7ad): created successfully Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ceadd0-6cc4-442d-b2b1-39dd8a92f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (bfe38cd9-fdd3-442b-afe2-42148217e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-597ee688-860a-4677-a412-8878265bf82d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created volume successfully. Sep 28 18:23:35 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 1073741824" returned: 0 in 0.617s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:35 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 Sep 28 18:23:35 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808" returned: 0 in 0.388s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730508466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ab16cd-e04f-49e9-8e2c-2dc012f17c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:33Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating volume c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:36 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f84dde-2610-494f-9ba7-14fe41b0716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0f4b38-4271-4df8-b866-99c57f539600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:36 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 1073741824 Sep 28 18:23:36 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Volume volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 (0af47a76-017d-4f56-b4bc-1d62c0c7b808): created successfully Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0f4b38-4271-4df8-b866-99c57f539600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (b68a64b1-7e83-497e-bcc3-59cf1b7625f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6f251ec1-483d-4f92-a1e7-fb1bda95a16f tempest-CreateVolumesFromImageTest-274725864 None] Created volume successfully. Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (17423990-5877-4520-9f6f-808f6211d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db67622b-84d3-4fd5-80aa-678fa0b6130d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db67622b-84d3-4fd5-80aa-678fa0b6130d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766350269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c15beca-dde6-4cc2-94e3-8a4f67325269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:36Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502d5dc2-7d2b-4fe1-a50f-1e1233b4a452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502d5dc2-7d2b-4fe1-a50f-1e1233b4a452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b373c7f7-c0d7-46d0-ac5c-e4b451754f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b373c7f7-c0d7-46d0-ac5c-e4b451754f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c15beca-dde6-4cc2-94e3-8a4f67325269', 'volume_name': 'volume-1c15beca-dde6-4cc2-94e3-8a4f67325269', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca03c20-f598-4772-87f2-688c20215080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca03c20-f598-4772-87f2-688c20215080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc06b87-9d83-469f-827c-83195171b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume 1c15beca-dde6-4cc2-94e3-8a4f67325269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c15beca-dde6-4cc2-94e3-8a4f67325269', 'volume_size': 1} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:36 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 1073741824" returned: 0 in 0.817s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:37 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 Sep 28 18:23:37 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (2dc42116-e1ba-4cf5-9677-5b2bcb5955c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93df1762-0102-4e83-986d-94b65b320654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93df1762-0102-4e83-986d-94b65b320654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157992090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ff376e-be83-438f-853b-c7231022ecf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:37Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144e6e84-4424-42c8-867f-74777766d890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144e6e84-4424-42c8-867f-74777766d890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cc53a7-fc58-4d1b-85b1-d896482bfc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cc53a7-fc58-4d1b-85b1-d896482bfc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ff376e-be83-438f-853b-c7231022ecf2', 'volume_name': 'volume-d7ff376e-be83-438f-853b-c7231022ecf2', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d94fc8-7722-4491-8051-f5907f3d4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d94fc8-7722-4491-8051-f5907f3d4095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c859842-5de3-4e9f-a83f-9cd8f9c7c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume d7ff376e-be83-438f-853b-c7231022ecf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ff376e-be83-438f-853b-c7231022ecf2', 'volume_size': 1} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:37 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356259128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1102822-f419-4fb2-84ad-b5a7cd9f2fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:33Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Creating volume a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe355cf3-9fe6-4973-b5ef-138c696440e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c27511-b143-48ab-af12-7b7d5061f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 1073741824 Sep 28 18:23:37 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 (c3ab16cd-e04f-49e9-8e2c-2dc012f17c98): created successfully Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c27511-b143-48ab-af12-7b7d5061f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (5f574bc0-417d-4b6d-859c-0d09b158187a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bcfd4ca8-1650-4aae-86fb-bacdf4695874 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created volume successfully. Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (a76d701b-88c3-4895-b924-36764ec80528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff0b0ed-58ae-441a-a478-bc899dd15c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff0b0ed-58ae-441a-a478-bc899dd15c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-553490585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44340e3c-f914-4e20-835e-33470a6933c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:38Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5335efc9-10f7-4e18-847f-75138fbc987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5335efc9-10f7-4e18-847f-75138fbc987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e777b2c5-81e3-4b67-bd06-d1b755a0989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e777b2c5-81e3-4b67-bd06-d1b755a0989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44340e3c-f914-4e20-835e-33470a6933c7', 'volume_name': 'volume-44340e3c-f914-4e20-835e-33470a6933c7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5036e4-7a5a-4f25-9bcb-3ba2140ff861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5036e4-7a5a-4f25-9bcb-3ba2140ff861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e2457c-5e97-402f-a14a-b678b691346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume 44340e3c-f914-4e20-835e-33470a6933c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44340e3c-f914-4e20-835e-33470a6933c7', 'volume_size': 1} Sep 28 18:23:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:38 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 1073741824" returned: 0 in 0.827s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:38 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 Sep 28 18:23:38 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Flow 'volume_create_manager' (fe453ad1-c605-46ca-b560-3b113a831750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2106d75-14d9-4c29-8595-f4428995ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2106d75-14d9-4c29-8595-f4428995ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386d738a-ec4e-436d-b9e1-91e25119487f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f786ea7b3da4d5aa4c4736f731a0cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:38Z,use_quota=True,user_id='f6980c1d4ce1437f903f5c3cf00769a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dca8702-39bf-4aeb-83de-3473b07c67e7),volume_type_id=1dca8702-39bf-4aeb-83de-3473b07c67e7)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389cf589-4fd9-48e7-b4ab-9b394149f741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389cf589-4fd9-48e7-b4ab-9b394149f741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3cc7e5-763b-4f34-bb7d-e92c114228dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:38 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (4f125c6b-1f71-4344-939f-ffa212b7e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fc8b56-a6a4-4847-9689-8502e1eec96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4" returned: 0 in 0.511s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.921s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424131274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd47c97-ccff-443f-b9d9-b62d9e66bb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:34Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Creating volume abd47c97-ccff-443f-b9d9-b62d9e66bb23 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:38 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:38 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 1073741824 Sep 28 18:23:38 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fc8b56-a6a4-4847-9689-8502e1eec96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441592481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60645313-36ec-44d5-9a84-bcb52bd8d707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:39Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8675f6-7ce7-4472-b6d1-48a37d42e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b8675f6-7ce7-4472-b6d1-48a37d42e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ecf149-6925-4222-a737-febc993021f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ecf149-6925-4222-a737-febc993021f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60645313-36ec-44d5-9a84-bcb52bd8d707', 'volume_name': 'volume-60645313-36ec-44d5-9a84-bcb52bd8d707', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51afc9ed-2170-482b-9f04-0d5cf38ee3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:38 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51afc9ed-2170-482b-9f04-0d5cf38ee3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb8d92f-3d2e-47e0-a616-9b2c1af75139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume 60645313-36ec-44d5-9a84-bcb52bd8d707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60645313-36ec-44d5-9a84-bcb52bd8d707', 'volume_size': 1} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ba8e37-580c-40e4-8e5f-8083665e2aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd58c0b-3b68-4baf-a5b2-d1b12115fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Volume volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 (a1102822-f419-4fb2-84ad-b5a7cd9f2fc4): created successfully Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd58c0b-3b68-4baf-a5b2-d1b12115fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (aa20a198-a917-4b9d-b232-320c0cf0e4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (917d560b-998b-4d77-b6cd-c346debac61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fc2517-8285-419a-bfce-36d880e276a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-00d95e7f-827b-45b5-9dfd-9bc98f30537c tempest-CreateVolumesFromImageTest-274725864 None] Created volume successfully. Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fc2517-8285-419a-bfce-36d880e276a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445284361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1c5454-2b0b-41e6-b35f-a8c27007ce3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:39Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b4981-a0e9-482f-a5ba-93477bf6efff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b4981-a0e9-482f-a5ba-93477bf6efff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c043b47f-1f71-4847-8092-ac21b858295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c043b47f-1f71-4847-8092-ac21b858295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd1c5454-2b0b-41e6-b35f-a8c27007ce3c', 'volume_name': 'volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7c4cf7-7079-44db-ac59-2d0274be73e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7c4cf7-7079-44db-ac59-2d0274be73e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab64897-0c4d-4dc4-8027-901b8d281691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume dd1c5454-2b0b-41e6-b35f-a8c27007ce3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c', 'volume_size': 1} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3cc7e5-763b-4f34-bb7d-e92c114228dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '386d738a-ec4e-436d-b9e1-91e25119487f', 'volume_name': 'volume-386d738a-ec4e-436d-b9e1-91e25119487f', 'volume_size': 1, 'image_id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d20cc61-3010-4666-9a75-3e31af62f20e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a91674dfc506f77797767dae7b4a9532', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f786ea7b3da4d5aa4c4736f731a0cb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51262c4054fa4ef64cf4abc351380f77b220bef0a041ce6328d81a5c30dabf86cd89cece42a90f233460ca4171736a7f45f872568f90a86d90b2aa2dd71a4a9d', 'id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d20cc61-3010-4666-9a75-3e31af62f20e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e44ed-5788-47cb-81db-502f0f801596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e44ed-5788-47cb-81db-502f0f801596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933ee5f1-c2d9-4af8-bf13-d3cda5dd5806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Volume 386d738a-ec4e-436d-b9e1-91e25119487f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-386d738a-ec4e-436d-b9e1-91e25119487f', 'volume_size': 1, 'image_id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d20cc61-3010-4666-9a75-3e31af62f20e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a91674dfc506f77797767dae7b4a9532', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f786ea7b3da4d5aa4c4736f731a0cb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51262c4054fa4ef64cf4abc351380f77b220bef0a041ce6328d81a5c30dabf86cd89cece42a90f233460ca4171736a7f45f872568f90a86d90b2aa2dd71a4a9d', 'id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d20cc61-3010-4666-9a75-3e31af62f20e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Trying to clone 386d738a-ec4e-436d-b9e1-91e25119487f from image 0d20cc61-3010-4666-9a75-3e31af62f20e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d20cc61-3010-4666-9a75-3e31af62f20e', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d7ab4c-f106-4bc2-8172-d60aaa37ed41]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:39 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 1073741824" returned: 0 in 0.730s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:39 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 Sep 28 18:23:39 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:39 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD Sep 28 18:23:39 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:39 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23" returned: 0 in 0.323s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.466s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370435441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5b38f9-3bf7-46ee-a284-57638a0d5b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf5a1be2b0343858a2ada973ee235fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:34Z,use_quota=True,user_id='809f87f55ffb409e9460990d0e19f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Creating volume 8a5b38f9-3bf7-46ee-a284-57638a0d5b99 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:39 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:40 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:40 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 1073741824 Sep 28 18:23:40 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2121eb76-8759-4cb2-aa79-704a2070db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a818eee4-0631-4d0d-bb4e-6298ad46b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Volume volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 (abd47c97-ccff-443f-b9d9-b62d9e66bb23): created successfully Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a818eee4-0631-4d0d-bb4e-6298ad46b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (38ca11d5-9402-4f9e-955d-009aad7b8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-47d7c61a-4ec1-4ea6-acc1-264dcfbb446f tempest-CreateVolumesFromImageTest-274725864 None] Created volume successfully. Sep 28 18:23:40 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD Sep 28 18:23:40 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:40 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Temporary image 0d20cc61-3010-4666-9a75-3e31af62f20e is fetched for user f6980c1d4ce1437f903f5c3cf00769a6. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aac5b3-b043-4cea-823e-883a84217d7e]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:40 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 1073741824" returned: 0 in 0.639s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:40 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD Sep 28 18:23:40 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:40 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 Sep 28 18:23:40 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:40 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766350269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c15beca-dde6-4cc2-94e3-8a4f67325269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:36Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Creating volume 1c15beca-dde6-4cc2-94e3-8a4f67325269 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:41 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD Sep 28 18:23:41 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695df73e-5a00-405c-8235-a66e9fb4c14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 1073741824 Sep 28 18:23:41 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f605e9-b960-4b50-a1dd-fd5718d928c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Volume volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 (8a5b38f9-3bf7-46ee-a284-57638a0d5b99): created successfully Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f605e9-b960-4b50-a1dd-fd5718d928c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Flow 'volume_create_manager' (da24c678-a8c5-4f3d-9381-4d48a067d82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-366d18e1-4bb8-42c4-8e2f-4200119569d2 tempest-CreateVolumesFromImageTest-274725864 None] Created volume successfully. Sep 28 18:23:41 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:41 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 1073741824" returned: 0 in 0.585s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-8a5b38f9-3bf7-46ee-a284-57638a0d5b99-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-8a5b38f9-3bf7-46ee-a284-57638a0d5b99-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:41 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 Sep 28 18:23:41 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-quobyte-8a5b38f9-3bf7-46ee-a284-57638a0d5b99" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-8a5b38f9-3bf7-46ee-a284-57638a0d5b99" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f7b765-8e67-4de5-917c-283b0ab5dc9e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 Sep 28 18:23:42 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269" returned: 0 in 0.377s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.882s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-157992090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ff376e-be83-438f-853b-c7231022ecf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:37Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Creating volume d7ff376e-be83-438f-853b-c7231022ecf2 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:42 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc06b87-9d83-469f-827c-83195171b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c15beca-dde6-4cc2-94e3-8a4f67325269', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe03d5c-b99c-41b2-a062-dbde884ea046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:42 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 1073741824 Sep 28 18:23:42 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 (1c15beca-dde6-4cc2-94e3-8a4f67325269): created successfully Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe03d5c-b99c-41b2-a062-dbde884ea046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (17423990-5877-4520-9f6f-808f6211d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7f8767d4-0ae1-4cad-89af-fbda1a51c225 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created volume successfully. Sep 28 18:23:42 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99" returned: 0 in 0.548s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99 Sep 28 18:23:42 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 1073741824" returned: 0 in 0.635s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:42 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 Sep 28 18:23:42 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:42 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-8a5b38f9-3bf7-46ee-a284-57638a0d5b99" returned: 0 in 0.469s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-8a5b38f9-3bf7-46ee-a284-57638a0d5b99" released by "delete_volume" :: held 1.084s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Created reservations ['e672d578-fb50-4e3a-986d-5b9d4b14dded', 'b1ef3c76-4d77-4964-a573-615f49faf72e', '6b8f706e-23ac-4dfd-8103-b0b5ae5f3b7b', 'c5fedab7-9c42-4f60-9d98-1bd7375f8e52'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:43 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.387s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-553490585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44340e3c-f914-4e20-835e-33470a6933c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:38Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Creating volume 44340e3c-f914-4e20-835e-33470a6933c7 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:43 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 1073741824 Sep 28 18:23:43 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c859842-5de3-4e9f-a83f-9cd8f9c7c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ff376e-be83-438f-853b-c7231022ecf2', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edccb0c-ac61-48a8-bec0-129d131d8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:43 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:43 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:43 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume volume-d7ff376e-be83-438f-853b-c7231022ecf2 (d7ff376e-be83-438f-853b-c7231022ecf2): created successfully Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edccb0c-ac61-48a8-bec0-129d131d8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (2dc42116-e1ba-4cf5-9677-5b2bcb5955c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ec155c31-9658-46cd-9fbf-c41098fae650 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created volume successfully. Sep 28 18:23:43 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.372s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Deleted volume successfully. Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ebe542de-0739-4392-bc0a-aabe81a387f1 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-8a5b38f9-3bf7-46ee-a284-57638a0d5b99-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:43 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 1073741824" returned: 0 in 0.660s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:43 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 Sep 28 18:23:43 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-abd47c97-ccff-443f-b9d9-b62d9e66bb23-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-abd47c97-ccff-443f-b9d9-b62d9e66bb23-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-quobyte-abd47c97-ccff-443f-b9d9-b62d9e66bb23" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-abd47c97-ccff-443f-b9d9-b62d9e66bb23" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8fb93e-0ddf-4773-9344-546fa3e84555]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7" returned: 0 in 0.345s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441592481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60645313-36ec-44d5-9a84-bcb52bd8d707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:39Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Creating volume 60645313-36ec-44d5-9a84-bcb52bd8d707 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:44 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 1073741824 Sep 28 18:23:44 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e2457c-5e97-402f-a14a-b678b691346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44340e3c-f914-4e20-835e-33470a6933c7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08025b8-98ae-47f1-ab20-face2ab8bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:44 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume volume-44340e3c-f914-4e20-835e-33470a6933c7 (44340e3c-f914-4e20-835e-33470a6933c7): created successfully Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08025b8-98ae-47f1-ab20-face2ab8bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (a76d701b-88c3-4895-b924-36764ec80528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:44 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 Sep 28 18:23:44 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3ac7f4da-e651-42f6-a691-f30547d2d7a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created volume successfully. Sep 28 18:23:44 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23" returned: 0 in 0.562s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23 Sep 28 18:23:44 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:44 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 1073741824" returned: 0 in 0.569s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:44 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 Sep 28 18:23:44 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-abd47c97-ccff-443f-b9d9-b62d9e66bb23" returned: 0 in 0.365s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-abd47c97-ccff-443f-b9d9-b62d9e66bb23" released by "delete_volume" :: held 1.003s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Created reservations ['682b721c-85c9-4462-8723-9ca4a768fa25', 'ce8b35ce-2443-4c95-9ff3-149324a9cb13', '756dafa4-5657-4480-97ef-659d4175fad6', '5e8eeb4a-c5cd-4f2b-ab8f-f37a0770018f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:45 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707" returned: 0 in 0.361s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445284361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd1c5454-2b0b-41e6-b35f-a8c27007ce3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4293e578302b422caa70c91dd0d83e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:39Z,use_quota=True,user_id='2807731d044a4a38878df4def17015a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Creating volume dd1c5454-2b0b-41e6-b35f-a8c27007ce3c {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:45 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb8d92f-3d2e-47e0-a616-9b2c1af75139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60645313-36ec-44d5-9a84-bcb52bd8d707', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:45 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c 1073741824 Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c44bd89-d873-4662-b4b6-875b1911b5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:45 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume volume-60645313-36ec-44d5-9a84-bcb52bd8d707 (60645313-36ec-44d5-9a84-bcb52bd8d707): created successfully Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c44bd89-d873-4662-b4b6-875b1911b5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (4f125c6b-1f71-4344-939f-ffa212b7e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8d3cdfc3-e6dd-4627-825e-d6143b249c0b tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created volume successfully. Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:45 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:45 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:45 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.378s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:45 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Deleted volume successfully. Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-1ba1f30d-3d2d-432e-976a-bc533eeae3f0 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-abd47c97-ccff-443f-b9d9-b62d9e66bb23-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:45 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c 1073741824" returned: 0 in 0.675s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c Sep 28 18:23:46 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:46 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c" returned: 0 in 0.416s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.146s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab64897-0c4d-4dc4-8027-901b8d281691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572cdbc3-afaf-47e4-b5ca-d77032d6b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating offline snapshot 217a62a2-d4bd-47a4-8834-5469766d8be0 of volume c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:23:46 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Volume volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c (dd1c5454-2b0b-41e6-b35f-a8c27007ce3c): created successfully Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572cdbc3-afaf-47e4-b5ca-d77032d6b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Flow 'volume_create_manager' (917d560b-998b-4d77-b6cd-c346debac61e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78495c6-133b-4e2e-b037-6d4949386072]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-98aec1c0-1723-4f12-b29a-d36301ca226c tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created volume successfully. Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-quobyte-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4" acquired by "delete_volume" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd07281-fd63-427d-9808-c9f260f60da3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:46 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 Sep 28 18:23:46 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:46 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 Sep 28 18:23:46 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-quobyte-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03c7bb7-ec7d-4fd0-abb1-2b4066e26059]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" returned: 0 in 0.556s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 1G Sep 28 18:23:47 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c Sep 28 18:23:47 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4" returned: 0 in 0.612s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4 Sep 28 18:23:47 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c" returned: 0 in 0.508s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c Sep 28 18:23:47 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 1G" returned: 0 in 0.573s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4" returned: 0 in 0.408s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4" released by "delete_volume" :: held 1.090s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:47 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 Sep 28 18:23:47 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Created reservations ['f1237e56-7004-49f8-8e66-7672be858883', '806dbdf6-d172-4dd3-81b8-83a8028748f2', 'f0a91b58-38e1-4768-a682-a890efeb6f4f', '86862d7d-369a-4d75-93fd-38d0731e2f5c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:47 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c" returned: 0 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:47 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:47 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:47 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c" released by "delete_volume" :: held 0.985s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created reservations ['d9e66f8c-b3cd-4f14-97ff-93fa83940eb4', 'd734cca2-74a9-4a85-bf21-cc87e2b3febb', '33a6a10b-fe9a-4c07-aeec-f74eb808a5c9', 'e07533b3-7826-4e44-8bc5-2b59303ce7da'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:48 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0" returned: 0 in 0.467s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 is being set with open permissions: ugo+rw Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:48 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 Sep 28 18:23:48 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.420s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Deleted volume successfully. Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2ecbc515-2ac8-4019-a846-2dd236562983 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-a1102822-f419-4fb2-84ad-b5a7cd9f2fc4-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:48 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0" returned: 0 in 0.317s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.337s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Deleted volume successfully. Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-28964354-8aef-4f7d-811f-477a7ae96bc0 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-dd1c5454-2b0b-41e6-b35f-a8c27007ce3c-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info Sep 28 18:23:48 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-0af47a76-017d-4f56-b4bc-1d62c0c7b808-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-0af47a76-017d-4f56-b4bc-1d62c0c7b808-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-quobyte-0af47a76-017d-4f56-b4bc-1d62c0c7b808" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-0af47a76-017d-4f56-b4bc-1d62c0c7b808" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:48 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info" returned: 0 in 0.338s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:48 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info is being set with open permissions: ugo+rw Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d5a49-3e1a-4032-b1a0-17ab2637b85f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:48 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info Sep 28 18:23:48 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:49 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 Sep 28 18:23:49 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:49 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.info" returned: 0 in 0.312s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.850s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386d738a-ec4e-436d-b9e1-91e25119487f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f786ea7b3da4d5aa4c4736f731a0cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:38Z,use_quota=True,user_id='f6980c1d4ce1437f903f5c3cf00769a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dca8702-39bf-4aeb-83de-3473b07c67e7),volume_type_id=1dca8702-39bf-4aeb-83de-3473b07c67e7)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Creating volume 386d738a-ec4e-436d-b9e1-91e25119487f {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:49 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-60645313-36ec-44d5-9a84-bcb52bd8d707-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f 1073741824 Sep 28 18:23:49 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-60645313-36ec-44d5-9a84-bcb52bd8d707-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ce639065-c0fa-4f76-8827-1cbc53a52c60 tempest-CreateVolumesFromSnapshotTest-57997033 None] Create snapshot completed successfully Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-quobyte-60645313-36ec-44d5-9a84-bcb52bd8d707" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-60645313-36ec-44d5-9a84-bcb52bd8d707" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:49 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808" returned: 0 in 0.500s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abe272-fb11-46b1-b0e1-1cbb812d5bc7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808 Sep 28 18:23:49 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:49 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 Sep 28 18:23:49 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:49 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0af47a76-017d-4f56-b4bc-1d62c0c7b808" returned: 0 in 0.308s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-0af47a76-017d-4f56-b4bc-1d62c0c7b808" released by "delete_volume" :: held 0.874s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Created reservations ['1edc56a9-4718-4886-b9e4-64560017b23b', 'cacdb21b-5b31-49d1-b01e-8364e0031b16', '07ac0b6f-39a9-4b86-8128-ebbc35727caf', 'b93dcb4f-ad60-4922-a4b8-dee3e03808bb'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:49 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f 1073741824" returned: 0 in 0.660s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:49 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:49 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-a08ae222-ecc3-4836-aa65-ce2b46d5645d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-a08ae222-ecc3-4836-aa65-ce2b46d5645d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:50 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f Sep 28 18:23:50 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707" returned: 0 in 0.640s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "cinder-quobyte-a08ae222-ecc3-4836-aa65-ce2b46d5645d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:50 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707 Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-a08ae222-ecc3-4836-aa65-ce2b46d5645d" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:50 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000a966-f223-4ac7-bd49-b301a6838c66]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Deleted volume successfully. Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-02b3df4c-ef0f-4233-9292-20a3237f8f30 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-0af47a76-017d-4f56-b4bc-1d62c0c7b808-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:50 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d Sep 28 18:23:50 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:50 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-60645313-36ec-44d5-9a84-bcb52bd8d707" returned: 0 in 0.508s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-60645313-36ec-44d5-9a84-bcb52bd8d707" released by "delete_volume" :: held 1.235s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:50 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f" returned: 0 in 0.638s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Attempting download of 0d20cc61-3010-4666-9a75-3e31af62f20e ((None, [{'url': 'file:///opt/stack/data/glance/images/0d20cc61-3010-4666-9a75-3e31af62f20e', 'metadata': {}}])) to volume 386d738a-ec4e-436d-b9e1-91e25119487f. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created reservations ['c11a0edc-43b0-4c19-bbc3-91bd6ff50af6', '04aec021-11f0-416c-9b50-1f6eb28c7d50', '59bbf005-4983-4d9b-87a2-1377c0c733ba', '342e9539-c203-4c3c-8853-c95dae9610c0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d77e66-d182-4280-bc2a-ed640abaa0ce]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (26caf55a-c1ea-41db-b1a0-75110924ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e344f104-2cf2-47d4-9f58-c3b79993d2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e344f104-2cf2-47d4-9f58-c3b79993d2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548709826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b69b8d-ad88-41f6-8485-20edc1930f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:51Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:50 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03a5525-84ee-4cfa-a1e7-80f574ed97f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03a5525-84ee-4cfa-a1e7-80f574ed97f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ee33e6-7795-4576-a627-cf10ec96dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ee33e6-7795-4576-a627-cf10ec96dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b69b8d-ad88-41f6-8485-20edc1930f93', 'volume_name': 'volume-03b69b8d-ad88-41f6-8485-20edc1930f93', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:51 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7 Sep 28 18:23:51 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a734e898-6a6e-4686-8925-10ddbd636a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a734e898-6a6e-4686-8925-10ddbd636a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6725a0ed-0bf5-4015-a47d-a0b36e5973f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume 03b69b8d-ad88-41f6-8485-20edc1930f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b69b8d-ad88-41f6-8485-20edc1930f93', 'volume_size': 1} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548709826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b69b8d-ad88-41f6-8485-20edc1930f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:51Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating volume 03b69b8d-ad88-41f6-8485-20edc1930f93 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:51 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d" returned: 0 in 0.870s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 1073741824 Sep 28 18:23:51 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d Sep 28 18:23:51 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:51 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7" returned: 0 in 0.623s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:51 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.420s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Deleted volume successfully. Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2324f1e0-50b9-4f23-afc4-cc0ac191d7a7 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-60645313-36ec-44d5-9a84-bcb52bd8d707-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:51 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-a08ae222-ecc3-4836-aa65-ce2b46d5645d" returned: 0 in 0.586s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-quobyte-a08ae222-ecc3-4836-aa65-ce2b46d5645d" released by "delete_volume" :: held 1.568s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:51 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7 Sep 28 18:23:51 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Created reservations ['e72e1644-c341-44ca-bad5-3adc03e266e0', '4583e2e4-ce4b-4d54-8fed-26575c883e93', '87a12222-6344-4475-86b0-a13bf6796605', 'd52211b9-9152-471f-b5e1-ce893398f360'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-44340e3c-f914-4e20-835e-33470a6933c7-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-44340e3c-f914-4e20-835e-33470a6933c7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:51 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 1073741824" returned: 0 in 0.932s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:52 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (2fdf37bf-b159-44c7-a559-498c4a5e8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6d193f-ae28-4cbd-9e44-30520e3898df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7" returned: 1 in 0.671s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d20cc61-3010-4666-9a75-3e31af62f20e_bxgbjzq7' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[661fcb9d-3fe0-4bee-8de6-e8c3aa9d6f4b]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6d193f-ae28-4cbd-9e44-30520e3898df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142451194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a11515-fd85-4864-8e82-718b54342833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:52Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:52 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:52 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8367e354-b457-4a6d-a38c-e156513d5220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8367e354-b457-4a6d-a38c-e156513d5220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0139119e-9e7b-408b-9a02-756ef44a2032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0139119e-9e7b-408b-9a02-756ef44a2032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a11515-fd85-4864-8e82-718b54342833', 'volume_name': 'volume-45a11515-fd85-4864-8e82-718b54342833', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6831a78-f1f5-46de-b191-d7b8e7a533a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6831a78-f1f5-46de-b191-d7b8e7a533a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba233041-0402-40d5-beae-385ba80fed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume 45a11515-fd85-4864-8e82-718b54342833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a11515-fd85-4864-8e82-718b54342833', 'volume_size': 1} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-quobyte-44340e3c-f914-4e20-835e-33470a6933c7" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-44340e3c-f914-4e20-835e-33470a6933c7" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938cf81-7ce0-4cd3-8871-202e9e2c471c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 Sep 28 18:23:52 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD Sep 28 18:23:52 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 Sep 28 18:23:52 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:52 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:52 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.731s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93" returned: 0 in 0.588s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142451194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a11515-fd85-4864-8e82-718b54342833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:52Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating volume 45a11515-fd85-4864-8e82-718b54342833 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:52 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Deleted volume successfully. Sep 28 18:23:53 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 1073741824 Sep 28 18:23:53 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (3d1642a9-3256-42a7-b499-162d1665c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e8da0a-4a03-4d85-944c-bb10a791a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6725a0ed-0bf5-4015-a47d-a0b36e5973f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b69b8d-ad88-41f6-8485-20edc1930f93', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50092a60-0d26-40ce-bb6c-fe0fe8e51f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD" returned: 0 in 1.037s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e8da0a-4a03-4d85-944c-bb10a791a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1862565265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688dcc3-80c4-4767-8704-dc5904a5e25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:53Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d382278-1233-48fd-94a9-0321900868fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d382278-1233-48fd-94a9-0321900868fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd23a470-cf9f-4614-a0e9-475a740eef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd23a470-cf9f-4614-a0e9-475a740eef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6688dcc3-80c4-4767-8704-dc5904a5e25e', 'volume_name': 'volume-6688dcc3-80c4-4767-8704-dc5904a5e25e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c37d91-7dca-4bc2-a330-535db396804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c37d91-7dca-4bc2-a330-535db396804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6780ee3-6eee-4a95-a83c-ef3a3a0702eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume 6688dcc3-80c4-4767-8704-dc5904a5e25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6688dcc3-80c4-4767-8704-dc5904a5e25e', 'volume_size': 1} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-48d757ce-808e-4faf-bf0c-2ffa261c8130 tempest-CreateVolumesFromImageTest-274725864 None] Lock "cinder-a08ae222-ecc3-4836-aa65-ce2b46d5645d-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume volume-03b69b8d-ad88-41f6-8485-20edc1930f93 (03b69b8d-ad88-41f6-8485-20edc1930f93): created successfully Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50092a60-0d26-40ce-bb6c-fe0fe8e51f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (26caf55a-c1ea-41db-b1a0-75110924ed47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:53 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD Sep 28 18:23:53 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7" returned: 0 in 1.031s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-928d17ff-03b3-452e-bde8-707a1dea049f tempest-CreateVolumesFromSnapshotTest-57997033 None] Created volume successfully. Sep 28 18:23:53 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7 Sep 28 18:23:53 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (b689bdc6-33ec-48d1-822d-0c5cc986cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e53bba-6066-4462-916c-759b81e5b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e53bba-6066-4462-916c-759b81e5b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820710645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2d568f-cb25-433f-b825-2b7afadffef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:53Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3c4bfb-e466-46f6-b174-6e635dd6a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3c4bfb-e466-46f6-b174-6e635dd6a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1980771a-d07a-4b64-bcc2-fd4fe828d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1980771a-d07a-4b64-bcc2-fd4fe828d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2d568f-cb25-433f-b825-2b7afadffef0', 'volume_name': 'volume-fd2d568f-cb25-433f-b825-2b7afadffef0', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7924d61-7f92-48e8-86fe-91e956c245c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7924d61-7f92-48e8-86fe-91e956c245c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ebb5d0-7c31-425f-8690-e2175ced84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume fd2d568f-cb25-433f-b825-2b7afadffef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2d568f-cb25-433f-b825-2b7afadffef0', 'volume_size': 1} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:53 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 1073741824" returned: 0 in 0.922s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD" returned: 1 in 0.741s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] 0d20cc61-3010-4666-9a75-3e31af62f20e was raw, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-44340e3c-f914-4e20-835e-33470a6933c7" returned: 0 in 0.564s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:53 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f Sep 28 18:23:53 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-44340e3c-f914-4e20-835e-33470a6933c7" released by "delete_volume" :: held 1.749s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:54 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 Sep 28 18:23:54 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created reservations ['46cac3c2-a01b-4c38-a3be-8108b95d9650', '211cb09f-441f-4b44-974f-a6a2c6f1a7c5', 'f9ca350f-9490-497f-8197-a3bd749d9624', '17b0dd02-0218-4869-b90f-4aed52548d1a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (f787beb8-dfd5-4297-8d41-8ab0ccf48c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8269fd-afb2-47c8-807e-67f3311afeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8269fd-afb2-47c8-807e-67f3311afeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530555143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd62516-0f96-4eeb-8975-331f790fd823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:54Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3112710c-ac48-4a81-b119-ebfe7f0794e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3112710c-ac48-4a81-b119-ebfe7f0794e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039f2709-bb2b-411e-8708-a968935b9904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039f2709-bb2b-411e-8708-a968935b9904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd62516-0f96-4eeb-8975-331f790fd823', 'volume_name': 'volume-5bd62516-0f96-4eeb-8975-331f790fd823', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1673830-09c7-4ea7-898c-4653535b4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1673830-09c7-4ea7-898c-4653535b4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b1620b-7409-4714-8f20-1fc903f2cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume 5bd62516-0f96-4eeb-8975-331f790fd823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd62516-0f96-4eeb-8975-331f790fd823', 'volume_size': 1} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:54 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-d7ff376e-be83-438f-853b-c7231022ecf2-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833" returned: 0 in 0.478s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1862565265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6688dcc3-80c4-4767-8704-dc5904a5e25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:53Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating volume 6688dcc3-80c4-4767-8704-dc5904a5e25e {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:54 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e 1073741824 Sep 28 18:23:54 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-d7ff376e-be83-438f-853b-c7231022ecf2-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba233041-0402-40d5-beae-385ba80fed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a11515-fd85-4864-8e82-718b54342833', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4051120c-e6a7-407c-a12b-27de7fe60399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:54 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:54 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:54 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume volume-45a11515-fd85-4864-8e82-718b54342833 (45a11515-fd85-4864-8e82-718b54342833): created successfully Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4051120c-e6a7-407c-a12b-27de7fe60399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (2fdf37bf-b159-44c7-a559-498c4a5e8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-fadbcb13-3005-4bae-8477-83e9ccf82306 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created volume successfully. Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-quobyte-d7ff376e-be83-438f-853b-c7231022ecf2" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-d7ff376e-be83-438f-853b-c7231022ecf2" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c552d0-6155-4222-9853-2fcc305edf20]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f" returned: 0 in 0.927s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d20cc61-3010-4666-9a75-3e31af62f20e_r4_4fdjudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:23:54 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:23:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:54 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f 1G Sep 28 18:23:54 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:55 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 Sep 28 18:23:55 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.410s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Deleted volume successfully. Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5d2b06d8-6fe1-46c6-83ee-0b6f66316d06 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-44340e3c-f914-4e20-835e-33470a6933c7-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:55 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e 1073741824" returned: 0 in 0.860s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:55 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e Sep 28 18:23:55 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:55 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f 1G" returned: 0 in 0.626s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Downloaded image 0d20cc61-3010-4666-9a75-3e31af62f20e ((None, [{'url': 'file:///opt/stack/data/glance/images/0d20cc61-3010-4666-9a75-3e31af62f20e', 'metadata': {}}])) to volume 386d738a-ec4e-436d-b9e1-91e25119487f successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:23:55 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Temporary image 0d20cc61-3010-4666-9a75-3e31af62f20e for user f6980c1d4ce1437f903f5c3cf00769a6 is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Marking volume 386d738a-ec4e-436d-b9e1-91e25119487f as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2" returned: 0 in 0.743s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Copying metadata from image 0d20cc61-3010-4666-9a75-3e31af62f20e to 386d738a-ec4e-436d-b9e1-91e25119487f. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Creating volume glance metadata for volume 386d738a-ec4e-436d-b9e1-91e25119487f backed by image 0d20cc61-3010-4666-9a75-3e31af62f20e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a91674dfc506f77797767dae7b4a9532', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:23:55 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2 Sep 28 18:23:55 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933ee5f1-c2d9-4af8-bf13-d3cda5dd5806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386d738a-ec4e-436d-b9e1-91e25119487f', 'volume_size': 1, 'image_id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d20cc61-3010-4666-9a75-3e31af62f20e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a91674dfc506f77797767dae7b4a9532', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f786ea7b3da4d5aa4c4736f731a0cb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51262c4054fa4ef64cf4abc351380f77b220bef0a041ce6328d81a5c30dabf86cd89cece42a90f233460ca4171736a7f45f872568f90a86d90b2aa2dd71a4a9d', 'id': '0d20cc61-3010-4666-9a75-3e31af62f20e', 'created_at': datetime.datetime(2026, 9, 28, 16, 23, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 23, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d20cc61-3010-4666-9a75-3e31af62f20e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16255e95-6727-42da-9888-ae65de1b400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Volume volume-386d738a-ec4e-436d-b9e1-91e25119487f (386d738a-ec4e-436d-b9e1-91e25119487f): created successfully Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16255e95-6727-42da-9888-ae65de1b400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Flow 'volume_create_manager' (fe453ad1-c605-46ca-b560-3b113a831750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5259a546-cc5e-4a41-b327-a218b03603fd tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Created volume successfully. Sep 28 18:23:55 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1820710645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2d568f-cb25-433f-b825-2b7afadffef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:53Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating volume fd2d568f-cb25-433f-b825-2b7afadffef0 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:55 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6780ee3-6eee-4a95-a83c-ef3a3a0702eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6688dcc3-80c4-4767-8704-dc5904a5e25e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 1073741824 Sep 28 18:23:55 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716fd110-9ae8-43e0-affa-0e812d77fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:55 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume volume-6688dcc3-80c4-4767-8704-dc5904a5e25e (6688dcc3-80c4-4767-8704-dc5904a5e25e): created successfully Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716fd110-9ae8-43e0-affa-0e812d77fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:55 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (3d1642a9-3256-42a7-b499-162d1665c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-232950b0-3ef6-4d36-b2c3-28b85a0aabd4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created volume successfully. Sep 28 18:23:56 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d7ff376e-be83-438f-853b-c7231022ecf2" returned: 0 in 0.461s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-d7ff376e-be83-438f-853b-c7231022ecf2" released by "delete_volume" :: held 1.280s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created reservations ['9bed4a13-6d9d-4d9b-9d42-5682df0f9535', 'a311211f-8424-49fd-93d1-c3c33520036e', '89bfc673-9f1f-4b7f-b563-f93a2ece0065', 'af1fdd0d-a4fb-405b-b4f0-a78e1f09992d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Acquiring lock "cinder-386d738a-ec4e-436d-b9e1-91e25119487f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "cinder-386d738a-ec4e-436d-b9e1-91e25119487f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Acquiring lock "cinder-quobyte-386d738a-ec4e-436d-b9e1-91e25119487f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "cinder-quobyte-386d738a-ec4e-436d-b9e1-91e25119487f" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[46560f50-5e40-4c57-8b07-0106d971e397]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:56 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f Sep 28 18:23:56 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 1073741824" returned: 0 in 0.790s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:56 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Deleted volume successfully. Sep 28 18:23:56 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 Sep 28 18:23:56 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d8c3be89-8006-446f-bc96-612b7af807a2 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-d7ff376e-be83-438f-853b-c7231022ecf2-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-1c15beca-dde6-4cc2-94e3-8a4f67325269-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-1c15beca-dde6-4cc2-94e3-8a4f67325269-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-quobyte-1c15beca-dde6-4cc2-94e3-8a4f67325269" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-1c15beca-dde6-4cc2-94e3-8a4f67325269" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa397b19-349d-436d-98cc-92c199cf344b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:56 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f" returned: 0 in 0.667s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f Sep 28 18:23:57 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530555143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd62516-0f96-4eeb-8975-331f790fd823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2e77117979345aeaf47ccf51f6da743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:23:54Z,use_quota=True,user_id='d41f0edd7b184040bba9675f56fa7879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Creating volume 5bd62516-0f96-4eeb-8975-331f790fd823 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:23:57 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 Sep 28 18:23:57 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ebb5d0-7c31-425f-8690-e2175ced84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2d568f-cb25-433f-b825-2b7afadffef0', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e4e805-895c-4e2e-94b9-cafcf342932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:57 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume volume-fd2d568f-cb25-433f-b825-2b7afadffef0 (fd2d568f-cb25-433f-b825-2b7afadffef0): created successfully Sep 28 18:23:57 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 1073741824 Sep 28 18:23:57 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e4e805-895c-4e2e-94b9-cafcf342932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (b689bdc6-33ec-48d1-822d-0c5cc986cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ac480376-e6a1-43f9-bef8-084d39df9538 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created volume successfully. Sep 28 18:23:57 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-386d738a-ec4e-436d-b9e1-91e25119487f" returned: 0 in 0.377s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "cinder-quobyte-386d738a-ec4e-436d-b9e1-91e25119487f" released by "delete_volume" :: held 1.108s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Created reservations ['f8cb6973-52fc-4c80-bc91-d0f84d2b61a2', '1522621d-3a55-4dec-bd62-34335f8674dd', 'bb23ba67-2152-45c7-91ae-13bb486a51a0', '3c332e98-6fbc-4551-91b2-caf7e3c40322'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:57 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269" returned: 0 in 0.567s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269 Sep 28 18:23:57 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:57 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 1073741824" returned: 0 in 0.744s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1c15beca-dde6-4cc2-94e3-8a4f67325269" returned: 0 in 0.351s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-1c15beca-dde6-4cc2-94e3-8a4f67325269" released by "delete_volume" :: held 0.973s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:57 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 Sep 28 18:23:57 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:57 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created reservations ['bb6b046f-5148-4d41-bd25-16b6dbefab9c', '6bb6bf2a-8cf5-4279-a11d-36c8fe0a06ae', '4c2fdd2f-ae9b-4832-8504-61965dd6deeb', '79215595-a270-48cc-897c-7bc2f0d11a61'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:58 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Deleted volume successfully. Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e0de7cc5-c04c-4b6a-ae52-afb57fe42803 tempest-VolumeAndVolumeTypeFromImageTest-1908492341 None] Lock "cinder-386d738a-ec4e-436d-b9e1-91e25119487f-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:58 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:23:58 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:58 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823" returned: 0 in 0.365s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b1620b-7409-4714-8f20-1fc903f2cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd62516-0f96-4eeb-8975-331f790fd823', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975950e5-ea94-4778-b7ce-a0c90c80e760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:23:58 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Volume volume-5bd62516-0f96-4eeb-8975-331f790fd823 (5bd62516-0f96-4eeb-8975-331f790fd823): created successfully Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975950e5-ea94-4778-b7ce-a0c90c80e760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Flow 'volume_create_manager' (f787beb8-dfd5-4297-8d41-8ab0ccf48c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:23:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-61fc53e5-1dd8-4f12-b7a8-14b31a15bb30 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created volume successfully. Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-fa56d98d-7996-41f7-9d36-5adcd1bbf2e7 tempest-ProjectAdminTests-1034653468 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1265678405762, 'free_capacity_gb': 1775.1265678405762, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87096) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:23:58 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.282s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Deleted volume successfully. Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-81ea55e3-eb8f-4c28-b0cd-821ce1fc2e92 tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-1c15beca-dde6-4cc2-94e3-8a4f67325269-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-5bd62516-0f96-4eeb-8975-331f790fd823-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-5bd62516-0f96-4eeb-8975-331f790fd823-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-5bd62516-0f96-4eeb-8975-331f790fd823" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-5bd62516-0f96-4eeb-8975-331f790fd823" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec1a1c6-e374-42f9-a503-670ee65072af]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:59 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 Sep 28 18:23:59 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "cinder-quobyte-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf117e-63cb-4d27-b059-c9b92330bd9c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad Sep 28 18:23:59 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823" returned: 0 in 0.602s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823 Sep 28 18:23:59 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad" returned: 0 in 0.583s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:59 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad Sep 28 18:23:59 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:59 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5bd62516-0f96-4eeb-8975-331f790fd823" returned: 0 in 0.363s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-5bd62516-0f96-4eeb-8975-331f790fd823" released by "delete_volume" :: held 1.036s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['f3193eaa-287f-4cfe-930d-ab6d5ed8484f', '6773184b-7d57-4855-b950-a4380831ce86', '22934a2a-b40d-481b-8dc9-ca958f6d6ef1', 'e6eed8f5-c524-4e65-bbf6-9cfe3440989d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:00 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad" returned: 0 in 0.385s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-quobyte-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad" released by "delete_volume" :: held 1.036s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Created reservations ['8fde32fd-4b5c-4856-ae93-fdc854c1072e', '024a5786-040a-42fa-965b-df30d7d62e8b', 'a29aa712-a581-4d7e-adc8-83eb280acec9', 'eab44a62-983e-489c-9200-19fa6ec1fca0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:00 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:00 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:00 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.435s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleted volume successfully. Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a815f18e-f1e9-427b-8466-a22cbeb288f5 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-5bd62516-0f96-4eeb-8975-331f790fd823-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:00 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.317s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Deleted volume successfully. Sep 28 18:24:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5ed14cea-5e9b-4147-90e8-ea38355aed1d tempest-CreateVolumesFromSourceVolumeTest-2057646814 None] Lock "cinder-f2976ea6-2c3f-4521-9c08-8b80fc4de7ad-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-fd2d568f-cb25-433f-b825-2b7afadffef0-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-fd2d568f-cb25-433f-b825-2b7afadffef0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-fd2d568f-cb25-433f-b825-2b7afadffef0" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-fd2d568f-cb25-433f-b825-2b7afadffef0" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2223b88-7385-47c6-a7ba-82bd50ca03c3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:01 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 Sep 28 18:24:01 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:01 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0" returned: 0 in 0.539s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:01 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0 Sep 28 18:24:01 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:02 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fd2d568f-cb25-433f-b825-2b7afadffef0" returned: 0 in 0.339s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-fd2d568f-cb25-433f-b825-2b7afadffef0" released by "delete_volume" :: held 0.940s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['e27fffc5-275c-4806-9194-77ef93a4b931', '5df0ddaf-fe4b-4ab4-bdfa-c6f79e49773f', 'ad693ff1-b071-4a40-a00e-1d0a3b5ce45b', 'ddc00744-9329-409f-9dc1-efb634ff7396'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:02 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:02 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:02 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.416s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:02 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleted volume successfully. Sep 28 18:24:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-06ab4467-48e2-450a-8f5e-566c00f36897 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-fd2d568f-cb25-433f-b825-2b7afadffef0-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-6688dcc3-80c4-4767-8704-dc5904a5e25e-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-6688dcc3-80c4-4767-8704-dc5904a5e25e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-6688dcc3-80c4-4767-8704-dc5904a5e25e" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-6688dcc3-80c4-4767-8704-dc5904a5e25e" acquired by "delete_volume" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2fe79-f119-44c2-b176-45db3231c9e1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:03 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e Sep 28 18:24:03 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e" returned: 0 in 0.473s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e Sep 28 18:24:04 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (a5fa1a6c-7441-4a50-85cf-f5eeae403634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b301a09c-494b-4148-9abb-16ed63725163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6688dcc3-80c4-4767-8704-dc5904a5e25e" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b301a09c-494b-4148-9abb-16ed63725163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891679261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2fe938-5125-4cc3-ba3f-3c171b513f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:05Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624d0950-d11b-4266-b3ed-0271aa12ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (624d0950-d11b-4266-b3ed-0271aa12ef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9297ed89-8be0-4a1f-892b-8414d1df74ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9297ed89-8be0-4a1f-892b-8414d1df74ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2fe938-5125-4cc3-ba3f-3c171b513f84', 'volume_name': 'volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e9cf5-4bea-4c14-b7c6-ca0ddf9452b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e9cf5-4bea-4c14-b7c6-ca0ddf9452b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df0fe4c-9937-41a4-8c3c-d92f0943eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:04 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Volume 0c2fe938-5125-4cc3-ba3f-3c171b513f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84', 'volume_size': 1} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891679261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2fe938-5125-4cc3-ba3f-3c171b513f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:05Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Creating volume 0c2fe938-5125-4cc3-ba3f-3c171b513f84 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:04 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-6688dcc3-80c4-4767-8704-dc5904a5e25e" released by "delete_volume" :: held 1.102s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:04 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 1073741824 Sep 28 18:24:04 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['16fd0725-745d-4614-be2d-608107e88654', '78f45f83-3d85-4f3b-bea6-d9129956b0ea', 'd4c30e91-b838-48f8-ac43-d6185a7071a9', '1ece06ed-f5d8-4cd0-9fce-c3c32333a2dd'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:05 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:05 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleted volume successfully. Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-aa443044-0972-431a-8fb2-1477f04c9c3c tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-6688dcc3-80c4-4767-8704-dc5904a5e25e-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:05 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 1073741824" returned: 0 in 0.664s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:05 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 Sep 28 18:24:05 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:05 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84" returned: 0 in 0.353s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-45a11515-fd85-4864-8e82-718b54342833-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df0fe4c-9937-41a4-8c3c-d92f0943eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff3ebbb-5819-41c0-a8f1-804bf14d0f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:05 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Volume volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 (0c2fe938-5125-4cc3-ba3f-3c171b513f84): created successfully Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff3ebbb-5819-41c0-a8f1-804bf14d0f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:05 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (a5fa1a6c-7441-4a50-85cf-f5eeae403634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-45a11515-fd85-4864-8e82-718b54342833-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Flow 'volume_create_manager' (ea2c5f1c-f4e2-4910-85c3-c525265456f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c982b42-680f-4136-8742-78cd7456a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3446df0f-04e0-4d29-90fb-733d384c1a9a tempest-ProjectReaderTests-2027229507 None] Created volume successfully. Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c982b42-680f-4136-8742-78cd7456a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1891687778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5689bc07-5bed-4c0d-b0e5-6e3412af358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1134f22c9fc48088de45b9f62e84c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:06Z,use_quota=True,user_id='90c69650321f4b909ab83749bdfe7bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7a3fb1-f65d-4944-ae85-4061a00e9642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7a3fb1-f65d-4944-ae85-4061a00e9642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdd23e7-a558-436d-880e-a29c57e2d727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdd23e7-a558-436d-880e-a29c57e2d727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5689bc07-5bed-4c0d-b0e5-6e3412af358e', 'volume_name': 'volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac212ad-68d3-444e-b9f0-66f555287441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac212ad-68d3-444e-b9f0-66f555287441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e397a598-d67f-4380-b286-a99e105f78e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:06 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Volume 5689bc07-5bed-4c0d-b0e5-6e3412af358e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e', 'volume_size': 1} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1891687778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5689bc07-5bed-4c0d-b0e5-6e3412af358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1134f22c9fc48088de45b9f62e84c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:06Z,use_quota=True,user_id='90c69650321f4b909ab83749bdfe7bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Creating volume 5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:06 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e 1073741824 Sep 28 18:24:06 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-45a11515-fd85-4864-8e82-718b54342833" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-45a11515-fd85-4864-8e82-718b54342833" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[da78ad44-fb32-40e6-932c-e79f350b2a84]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 Sep 28 18:24:06 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e 1073741824" returned: 0 in 0.576s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833" returned: 0 in 0.503s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833 Sep 28 18:24:06 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:06 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e Sep 28 18:24:06 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-0c2fe938-5125-4cc3-ba3f-3c171b513f84-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-0c2fe938-5125-4cc3-ba3f-3c171b513f84-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-quobyte-0c2fe938-5125-4cc3-ba3f-3c171b513f84" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-0c2fe938-5125-4cc3-ba3f-3c171b513f84" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:07 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-45a11515-fd85-4864-8e82-718b54342833" returned: 0 in 0.430s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab2ce1-5bf5-4202-8077-ed8a1d866ac1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e397a598-d67f-4380-b286-a99e105f78e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed02c6e4-53e9-462a-9f67-917d1cb17919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-45a11515-fd85-4864-8e82-718b54342833" released by "delete_volume" :: held 1.018s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:07 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Volume volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e (5689bc07-5bed-4c0d-b0e5-6e3412af358e): created successfully Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed02c6e4-53e9-462a-9f67-917d1cb17919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Flow 'volume_create_manager' (ea2c5f1c-f4e2-4910-85c3-c525265456f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-62b44dc0-7f57-4bce-a0f4-ef170111f8bd tempest-VolumeDependencyTests-225654867 None] Created volume successfully. Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['2c667568-699b-4707-adce-ecc1ab827e56', '84db2114-21c9-443d-98fc-88bda984eabf', 'e4bfd143-e2da-4139-bfad-3d96f1e7265b', '3e1f9bdb-e0ff-49e2-a498-e65b868e594b'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:07 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 Sep 28 18:24:07 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:07 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84" returned: 0 in 0.438s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:07 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84 Sep 28 18:24:07 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:07 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleted volume successfully. Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-59c7d6c0-2a09-407e-b457-18992c8f3118 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-45a11515-fd85-4864-8e82-718b54342833-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:07 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0c2fe938-5125-4cc3-ba3f-3c171b513f84" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-0c2fe938-5125-4cc3-ba3f-3c171b513f84" released by "delete_volume" :: held 0.798s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Created reservations ['fae55a42-ad23-4083-a274-ec4cdeb0b00e', 'b13a6b25-6f42-43d8-bf5c-a1c24af29165', '80c483e3-44fe-48af-aa88-16b95f5fd956', 'a3ef24e4-c1b0-473e-9e43-7333109ffb74'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:08 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Creating offline snapshot 8d8e5eb0-0660-49cc-aa94-b36d29917bf1 of volume 5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-03b69b8d-ad88-41f6-8485-20edc1930f93-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[34750879-4ce7-43cb-a531-fb197fa0f7f4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-03b69b8d-ad88-41f6-8485-20edc1930f93-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:08 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.368s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Deleted volume successfully. Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-03b69b8d-ad88-41f6-8485-20edc1930f93" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-58b9ca0f-8150-4dda-b816-d01548e272f4 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-0c2fe938-5125-4cc3-ba3f-3c171b513f84-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-03b69b8d-ad88-41f6-8485-20edc1930f93" acquired by "delete_volume" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b68cf1-cf79-45ea-bf0d-b422ecb2f7f0]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e Sep 28 18:24:08 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 Sep 28 18:24:08 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:08 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e" returned: 0 in 0.677s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93" returned: 0 in 0.522s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 1G Sep 28 18:24:09 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:09 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93 Sep 28 18:24:09 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (0a979192-3b3e-4795-9cf0-667ab9f616ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7601260-c24f-494a-bac9-a0824ad4fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7601260-c24f-494a-bac9-a0824ad4fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991557425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8a1470-68dd-4c6b-b06c-54670bae825c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:09Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0aefdad-5958-43c6-8f18-9e92e33145c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0aefdad-5958-43c6-8f18-9e92e33145c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967b5487-d7eb-4c9d-80b9-656de9039790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967b5487-d7eb-4c9d-80b9-656de9039790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8a1470-68dd-4c6b-b06c-54670bae825c', 'volume_name': 'volume-5c8a1470-68dd-4c6b-b06c-54670bae825c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6518c5-941b-441d-8ed5-6f645eff8c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6518c5-941b-441d-8ed5-6f645eff8c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9760a187-fe6e-42a9-b772-742e0967fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Volume 5c8a1470-68dd-4c6b-b06c-54670bae825c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8a1470-68dd-4c6b-b06c-54670bae825c', 'volume_size': 1} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-03b69b8d-ad88-41f6-8485-20edc1930f93" returned: 0 in 0.316s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-03b69b8d-ad88-41f6-8485-20edc1930f93" released by "delete_volume" :: held 0.910s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['88173366-da76-4f82-97f2-3451fce5c405', 'e203d53a-3f58-4e52-8b9b-c34163e2c924', 'e1da1942-57e4-4f36-94fc-fb0224929fd0', 'fd4683c3-6473-478f-98a8-da8b2dc09f0e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:09 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 1G" returned: 0 in 0.704s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 Sep 28 18:24:09 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.301s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleted volume successfully. Sep 28 18:24:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a154a75d-f671-481d-a40c-41a4e015c7a4 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-03b69b8d-ad88-41f6-8485-20edc1930f93-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:10 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1" returned: 0 in 0.415s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 is being set with open permissions: ugo+rw Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 Sep 28 18:24:10 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1" returned: 0 in 0.334s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info Sep 28 18:24:10 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-217a62a2-d4bd-47a4-8834-5469766d8be0-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-217a62a2-d4bd-47a4-8834-5469766d8be0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-217a62a2-d4bd-47a4-8834-5469766d8be0" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-217a62a2-d4bd-47a4-8834-5469766d8be0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleting offline snapshot 217a62a2-d4bd-47a4-8834-5469766d8be0 of volume c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] snapshot_file for this snap is: volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd12f45-0981-41ad-8c88-fed96fe54c82]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info" returned: 0 in 0.326s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info is being set with open permissions: ugo+rw Sep 28 18:24:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info Sep 28 18:24:10 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 Sep 28 18:24:10 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.info" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.956s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991557425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8a1470-68dd-4c6b-b06c-54670bae825c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:09Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Creating volume 5c8a1470-68dd-4c6b-b06c-54670bae825c {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:11 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:11 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0" returned: 0 in 0.424s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:11 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c 1073741824 Sep 28 18:24:11 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a601ec-0b4a-49d6-922e-77a3ae97dc37]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-24dd29bc-d2c5-433c-a84a-af7cba39eb78 tempest-VolumeDependencyTests-225654867 None] Create snapshot completed successfully Sep 28 18:24:11 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 Sep 28 18:24:11 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c 1073741824" returned: 0 in 0.597s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" returned: 0 in 0.552s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 Sep 28 18:24:11 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c Sep 28 18:24:11 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:12 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c" returned: 0 in 0.307s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9760a187-fe6e-42a9-b772-742e0967fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8a1470-68dd-4c6b-b06c-54670bae825c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d72aee2-62d8-4001-b02f-2751717c176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:12 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Volume volume-5c8a1470-68dd-4c6b-b06c-54670bae825c (5c8a1470-68dd-4c6b-b06c-54670bae825c): created successfully Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d72aee2-62d8-4001-b02f-2751717c176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (0a979192-3b3e-4795-9cf0-667ab9f616ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:12 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-39691b9e-80a9-47a3-8c96-43bbf376abaf tempest-ProjectReaderTests-2027229507 None] Created volume successfully. Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Flow 'volume_create_manager' (af44c55f-d5b7-4dfb-b5e2-e7fc148452f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cc11dc-9c9e-414e-b6b4-193be2fbe1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:12 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0" returned: 0 in 0.566s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cc11dc-9c9e-414e-b6b4-193be2fbe1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-376480684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1134f22c9fc48088de45b9f62e84c27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d8e5eb0-0660-49cc-aa94-b36d29917bf1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:12Z,use_quota=True,user_id='90c69650321f4b909ab83749bdfe7bb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:12 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0 Sep 28 18:24:12 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fa28ad-06d7-4732-98fd-50e100f9433b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fa28ad-06d7-4732-98fd-50e100f9433b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06bccc0-643c-474e-98b5-163b6875ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06bccc0-643c-474e-98b5-163b6875ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5', 'volume_name': 'volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5', 'volume_size': 1, 'snapshot_id': '8d8e5eb0-0660-49cc-aa94-b36d29917bf1'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6c4ea5-aaab-4bec-a389-bef25f1f88e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6c4ea5-aaab-4bec-a389-bef25f1f88e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a7fe6d-be00-4fc2-bc8c-2a67af197c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:12 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Volume 1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5', 'volume_size': 1, 'snapshot_id': '8d8e5eb0-0660-49cc-aa94-b36d29917bf1'} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-quobyte-8d8e5eb0-0660-49cc-aa94-b36d29917bf1-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-8d8e5eb0-0660-49cc-aa94-b36d29917bf1-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Creating volume 1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 from snapshot 8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-quobyte-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] snapshot: 8d8e5eb0-0660-49cc-aa94-b36d29917bf1, volume: 1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f85d0cc-1dd6-49c8-b05f-3433ab4f8faf]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:12 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98.217a62a2-d4bd-47a4-8834-5469766d8be0" returned: 0 in 0.381s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:12 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 Sep 28 18:24:12 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-217a62a2-d4bd-47a4-8834-5469766d8be0" released by "_delete_snapshot" :: held 2.088s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" released by "delete_snapshot" :: held 2.117s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:12 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['0ea1c27b-ac31-4469-87de-528559edd6f9', '7c27dfae-402b-4cd4-a504-336afe1c0fd8', '00baa3da-4667-46f0-b2e4-e540c78f53a5', 'c98435a5-4eef-4270-b54a-a999f6a45748'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:13 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Delete snapshot completed successfully. Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-97720335-a848-4a5a-8762-04ab40f35eb9 tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-217a62a2-d4bd-47a4-8834-5469766d8be0-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:13 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1" returned: 0 in 0.511s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1ac8c-d65f-4f6c-91d8-bbace9dfe563]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:13 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e Sep 28 18:24:13 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-5c8a1470-68dd-4c6b-b06c-54670bae825c-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-5c8a1470-68dd-4c6b-b06c-54670bae825c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-quobyte-5c8a1470-68dd-4c6b-b06c-54670bae825c" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-5c8a1470-68dd-4c6b-b06c-54670bae825c" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[82533539-f28f-4f79-a724-6dfd846b0367]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:13 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:24:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:13 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c Sep 28 18:24:13 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:13 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 Sep 28 18:24:13 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:14 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c" returned: 0 in 0.486s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:14 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c Sep 28 18:24:14 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "cinder-quobyte-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d072c3a-2dec-4360-b190-6f0ffaf3a09f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:14 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 Sep 28 18:24:14 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:14 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5c8a1470-68dd-4c6b-b06c-54670bae825c" returned: 0 in 0.405s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-5c8a1470-68dd-4c6b-b06c-54670bae825c" released by "delete_volume" :: held 0.971s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Created reservations ['5421b45a-b34f-432e-b2f6-43354346abde', '7108e977-b7f4-4021-8418-31a7db0583bf', '6d0e4232-968a-4b87-99fa-ba40474dd85c', 'e08b5017-cae3-429a-9d99-16d6f19a759d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:14 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" returned: 0 in 0.694s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:14 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:14 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:15 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98 Sep 28 18:24:15 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:15 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.415s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:15 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Deleted volume successfully. Sep 28 18:24:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d91884ae-bda0-4787-a32d-d63ce36b9426 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-5c8a1470-68dd-4c6b-b06c-54670bae825c-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:15 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" returned: 0 in 0.704s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-quobyte-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98" released by "delete_volume" :: held 1.502s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:15 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Created reservations ['84f6ab0f-79b7-4639-97b9-cfffacbf6ec3', 'f8e3ae61-6ab4-46e8-9ea7-525ac1bac917', 'efc3f57d-d4a4-469b-85e4-ebb52f206b5a', 'c8d1b1fd-73d5-4f4b-a667-8a22b99419d6'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:16 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:16 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:16 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:17 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 1.093s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (683660df-5566-4465-9a20-cd7c3ecd2768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c2e02-bfaf-4342-adad-8580ee5b69be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Deleted volume successfully. Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023c2e02-bfaf-4342-adad-8580ee5b69be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13564279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fd1f26-2d0e-43b2-aeca-7f6831d0847e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:17Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad7610c-f966-495e-bad9-021dec1d62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad7610c-f966-495e-bad9-021dec1d62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d7d47-fa10-47e2-929e-520b40244d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4d7d47-fa10-47e2-929e-520b40244d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5fd1f26-2d0e-43b2-aeca-7f6831d0847e', 'volume_name': 'volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a9fcba-b547-4b61-aa95-cc75c8f1f0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a9fcba-b547-4b61-aa95-cc75c8f1f0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c03ae1-9978-46b4-98dd-a025f5c149ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:17 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Volume d5fd1f26-2d0e-43b2-aeca-7f6831d0847e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e', 'volume_size': 1} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e9b6a173-f450-45b0-929a-78355b8c77cf tempest-CreateVolumesFromSnapshotTest-57997033 None] Lock "cinder-c3ab16cd-e04f-49e9-8e2c-2dc012f17c98-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:22 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" returned: 0 in 9.010s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:22 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:22 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Converted 1024.00 MB image at 113.63 MB/s Sep 28 18:24:22 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 is being set with open permissions: ugo+rw Sep 28 18:24:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:22 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 Sep 28 18:24:22 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" released by "_copy_volume_from_snapshot" :: held 10.411s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=164,cinder:UPDATE=239,cinder:DELETE=22,cinder:INSERT=66 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-8d8e5eb0-0660-49cc-aa94-b36d29917bf1-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" released by "_create_volume_from_snapshot" :: held 10.512s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.535s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.665s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-13564279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fd1f26-2d0e-43b2-aeca-7f6831d0847e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:17Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Creating volume d5fd1f26-2d0e-43b2-aeca-7f6831d0847e {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:23 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e 1073741824 Sep 28 18:24:23 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a7fe6d-be00-4fc2-bc8c-2a67af197c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5', 'volume_size': 1, 'snapshot_id': '8d8e5eb0-0660-49cc-aa94-b36d29917bf1'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c03af1e-6fe7-4b29-8150-5faa8ef389e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:23 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Volume volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 (1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5): created successfully Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c03af1e-6fe7-4b29-8150-5faa8ef389e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Flow 'volume_create_manager' (af44c55f-d5b7-4dfb-b5e2-e7fc148452f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d39ad87a-4bb9-4e4d-b62d-6c4011ed4aec tempest-VolumeDependencyTests-225654867 None] Created volume successfully. Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:23 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:23 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e 1073741824" returned: 0 in 0.685s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:23 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e Sep 28 18:24:23 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-8d8e5eb0-0660-49cc-aa94-b36d29917bf1-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Lock "cinder-8d8e5eb0-0660-49cc-aa94-b36d29917bf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-quobyte-5689bc07-5bed-4c0d-b0e5-6e3412af358e" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-5689bc07-5bed-4c0d-b0e5-6e3412af358e" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-quobyte-8d8e5eb0-0660-49cc-aa94-b36d29917bf1" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:24 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e" returned: 0 in 0.370s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:24 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-8d8e5eb0-0660-49cc-aa94-b36d29917bf1" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Deleting offline snapshot 8d8e5eb0-0660-49cc-aa94-b36d29917bf1 of volume 5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] snapshot_file for this snap is: volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.534s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c03ae1-9978-46b4-98dd-a025f5c149ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af51fcf2-6f4c-4196-a390-8009e70ff766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11013f6-e9bb-4921-8322-7e7313a33854]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:24:24 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Volume volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e (d5fd1f26-2d0e-43b2-aeca-7f6831d0847e): created successfully Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af51fcf2-6f4c-4196-a390-8009e70ff766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (683660df-5566-4465-9a20-cd7c3ecd2768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ba335a70-1900-484e-ba49-dc02d9f89e29 tempest-ProjectReaderTests-2027229507 None] Created volume successfully. Sep 28 18:24:24 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 Sep 28 18:24:24 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:24 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1" returned: 0 in 0.515s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6985bad-211d-4f35-90dc-52df49da9372]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:24 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e Sep 28 18:24:24 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-quobyte-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8ba166-770b-4bf9-aeac-ba7eca6f1d3b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e Sep 28 18:24:25 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e" returned: 0 in 0.795s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 Sep 28 18:24:25 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:25 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e" returned: 0 in 0.597s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:25 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e Sep 28 18:24:25 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e" returned: 0 in 0.333s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e" released by "delete_volume" :: held 1.008s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:26 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1 Sep 28 18:24:26 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Created reservations ['6869caa0-6390-441d-9f50-5af91d1705a8', '58b2ccbe-3b9f-445d-994b-20dcfa549a74', '09e54d99-f27d-4ee3-933f-85d6740009dd', '7951d8ec-0ff7-4438-8feb-f2b50dd99566'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:26 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:26 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:26 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e.8d8e5eb0-0660-49cc-aa94-b36d29917bf1" returned: 0 in 0.386s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-8d8e5eb0-0660-49cc-aa94-b36d29917bf1" released by "_delete_snapshot" :: held 2.388s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-5689bc07-5bed-4c0d-b0e5-6e3412af358e" released by "delete_snapshot" :: held 2.443s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Created reservations ['7505236b-7356-48ee-b6e9-14ec3be9381a', '969a6a05-2c52-440d-ad54-0e6b624143fe', '843a4b51-143d-40f7-9a6b-85ed4e1a6935', '9f580f67-5e44-4e61-b7f3-bb90d13e1d99'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:26 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.378s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Deleted volume successfully. Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3dba17d0-e232-4656-9d85-9c2df9c92637 tempest-ProjectReaderTests-2027229507 None] Lock "cinder-d5fd1f26-2d0e-43b2-aeca-7f6831d0847e-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Delete snapshot completed successfully. Sep 28 18:24:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9da5c68c-fc98-4266-bac1-d44b6c5c5b2b tempest-VolumeDependencyTests-225654867 None] Lock "cinder-8d8e5eb0-0660-49cc-aa94-b36d29917bf1-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-5689bc07-5bed-4c0d-b0e5-6e3412af358e-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Flow 'volume_create_manager' (9b236933-7554-4d4e-892d-0246ab892a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d5186e-a741-44d7-b75c-a92aa96df4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Lock "cinder-5689bc07-5bed-4c0d-b0e5-6e3412af358e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d5186e-a741-44d7-b75c-a92aa96df4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d967810c-b3f8-45b8-96fd-0e35fbbb5f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a309a73442434dd890da49c0d0f37e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:28Z,use_quota=True,user_id='46384fc2f7f8410e9feb1a8361b3ffbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db3b52-cfe1-4403-8452-d4fc160704e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db3b52-cfe1-4403-8452-d4fc160704e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b309a9f2-c7ea-4dde-8afc-d1f887a4c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:27 devstack cinder-volume[87096]: DEBUG cinder.image.glance [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Creating Keystone auth plugin from conf {{(pid=87096) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-quobyte-5689bc07-5bed-4c0d-b0e5-6e3412af358e" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-5689bc07-5bed-4c0d-b0e5-6e3412af358e" acquired by "delete_volume" :: waited 0.044s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8886b11e-9d6f-414d-bad2-db6b5b16cf81]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (cf2b6855-6848-4c17-9cb3-5aea74aef308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3069bc5f-c1ab-460a-a601-56e2a98aeb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3069bc5f-c1ab-460a-a601-56e2a98aeb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757795718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9757665-124c-4c20-957d-fd71a12b87ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:28Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cdd31a9-6268-4064-81ea-08ca294d6a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cdd31a9-6268-4064-81ea-08ca294d6a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4458b7-7995-41ba-b39f-59722e04a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4458b7-7995-41ba-b39f-59722e04a6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9757665-124c-4c20-957d-fd71a12b87ef', 'volume_name': 'volume-b9757665-124c-4c20-957d-fd71a12b87ef', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a164ee06-349a-4245-bb3d-75249b60fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a164ee06-349a-4245-bb3d-75249b60fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09276b2a-2370-4460-a7b7-b16f6b8bfd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Volume b9757665-124c-4c20-957d-fd71a12b87ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9757665-124c-4c20-957d-fd71a12b87ef', 'volume_size': 1} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757795718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9757665-124c-4c20-957d-fd71a12b87ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710438837d094d1692448166b6be5da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:28Z,use_quota=True,user_id='8205fbaa63124632965c5acc5940d49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Creating volume b9757665-124c-4c20-957d-fd71a12b87ef {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:28 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e Sep 28 18:24:28 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef 1073741824 Sep 28 18:24:28 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b309a9f2-c7ea-4dde-8afc-d1f887a4c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd967810c-b3f8-45b8-96fd-0e35fbbb5f36', 'volume_name': 'volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36', 'volume_size': 1, 'image_id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c305e529-0e9a-4929-bd5f-5abbee11f381', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0818a0ed3a3520bdbdc730601ad7bb64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a309a73442434dd890da49c0d0f37e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79dbfd88802fd468c9db7c1fb035789e5773a6c7eea93f6bc6e961f7f724b97d0ddcab9153639a070c68649b039410c9c0fce0f0624c67fc502d57a155df805a', 'id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'created_at': datetime.datetime(2026, 9, 28, 16, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c305e529-0e9a-4929-bd5f-5abbee11f381/file', 'properties': {}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c1aa88-d192-4203-817d-6ed34e090ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c1aa88-d192-4203-817d-6ed34e090ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0039b549-e273-42f0-9c0e-12aa4b716827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:28 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Volume d967810c-b3f8-45b8-96fd-0e35fbbb5f36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36', 'volume_size': 1, 'image_id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c305e529-0e9a-4929-bd5f-5abbee11f381', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0818a0ed3a3520bdbdc730601ad7bb64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a309a73442434dd890da49c0d0f37e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79dbfd88802fd468c9db7c1fb035789e5773a6c7eea93f6bc6e961f7f724b97d0ddcab9153639a070c68649b039410c9c0fce0f0624c67fc502d57a155df805a', 'id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'created_at': datetime.datetime(2026, 9, 28, 16, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c305e529-0e9a-4929-bd5f-5abbee11f381/file', 'properties': {}}, 'image_service': } Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Trying to clone d967810c-b3f8-45b8-96fd-0e35fbbb5f36 from image c305e529-0e9a-4929-bd5f-5abbee11f381 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c305e529-0e9a-4929-bd5f-5abbee11f381', 'metadata': {}}]). {{(pid=87096) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:24:28 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e" returned: 0 in 0.493s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e Sep 28 18:24:28 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:24:28 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[23706a79-a329-44e8-83fc-aec1d8e2ba2a]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef 1073741824" returned: 0 in 0.602s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:28 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD Sep 28 18:24:28 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:28 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef Sep 28 18:24:28 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-5689bc07-5bed-4c0d-b0e5-6e3412af358e" returned: 0 in 0.442s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-5689bc07-5bed-4c0d-b0e5-6e3412af358e" released by "delete_volume" :: held 1.048s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Created reservations ['9588d2b3-d109-4ee8-b275-58d024e96078', '2d25d792-ddf4-4359-9bc2-4a48b63254f6', 'f7630f65-1fc0-46b2-8301-dc3f9a330224', '123239da-92fd-4ae7-ae78-67f0ae51063c'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:29 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef" returned: 0 in 0.371s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09276b2a-2370-4460-a7b7-b16f6b8bfd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9757665-124c-4c20-957d-fd71a12b87ef', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe40c66-d2bb-4184-be0b-0efc9dc30d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:29 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Volume volume-b9757665-124c-4c20-957d-fd71a12b87ef (b9757665-124c-4c20-957d-fd71a12b87ef): created successfully Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe40c66-d2bb-4184-be0b-0efc9dc30d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Flow 'volume_create_manager' (cf2b6855-6848-4c17-9cb3-5aea74aef308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d4046a7a-ebbb-44c1-8203-ccac6d96dc8f tempest-ProjectReaderTests-2027229507 None] Created volume successfully. Sep 28 18:24:29 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:29 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD Sep 28 18:24:29 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:29 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Temporary image c305e529-0e9a-4929-bd5f-5abbee11f381 is fetched for user 46384fc2f7f8410e9feb1a8361b3ffbf. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:24:29 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.324s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Deleted volume successfully. Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5bd8e71e-bcfe-497f-bb13-618df698245d tempest-VolumeDependencyTests-225654867 None] Lock "cinder-5689bc07-5bed-4c0d-b0e5-6e3412af358e-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7985c6-23b1-4097-9c43-15a8071f4426]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:29 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD Sep 28 18:24:29 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Lock "cinder-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:30 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Acquiring lock "cinder-quobyte-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-b9757665-124c-4c20-957d-fd71a12b87ef-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:30 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" acquired by "delete_volume" :: waited 0.036s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Lock "cinder-b9757665-124c-4c20-957d-fd71a12b87ef-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff85fb-3143-4dde-b0c4-8a2b03bdd3e6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Acquiring lock "cinder-quobyte-b9757665-124c-4c20-957d-fd71a12b87ef" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-b9757665-124c-4c20-957d-fd71a12b87ef" acquired by "delete_volume" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ca8480-0813-4188-97ca-38470b55e872]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 Sep 28 18:24:30 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD" returned: 1 in 0.503s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d967810c-b3f8-45b8-96fd-0e35fbbb5f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a309a73442434dd890da49c0d0f37e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:28Z,use_quota=True,user_id='46384fc2f7f8410e9feb1a8361b3ffbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Creating volume d967810c-b3f8-45b8-96fd-0e35fbbb5f36 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:30 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:30 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 1073741824 Sep 28 18:24:30 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef Sep 28 18:24:30 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:30 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" returned: 0 in 0.604s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5 Sep 28 18:24:31 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef" returned: 0 in 0.554s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef Sep 28 18:24:31 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 1073741824" returned: 0 in 0.668s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 Sep 28 18:24:31 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" returned: 0 in 0.455s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Lock "cinder-quobyte-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5" released by "delete_volume" :: held 1.149s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:31 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b9757665-124c-4c20-957d-fd71a12b87ef" returned: 0 in 0.415s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Lock "cinder-quobyte-b9757665-124c-4c20-957d-fd71a12b87ef" released by "delete_volume" :: held 1.062s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Created reservations ['c4ac715c-d7b6-4c12-a350-ee34176440d6', 'e041b2c1-621b-4663-8e15-619ad3ee6010', '8db4dc90-c6d7-4122-b3f7-64df9206ff4e', 'd32efc54-99b6-4a02-a5d6-325b34cb39ba'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Created reservations ['5b36942c-3e8f-4e9e-b750-e8d3f367f282', '3bf5555b-d32c-43d5-b8fb-005a96dd1d1d', '4f11cb7d-9d66-4e3b-ac1d-0724baaee90a', '1cfe0822-288a-4bbd-bb8f-95239cb819c0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=191,cinder:UPDATE=273,cinder:INSERT=66,cinder:DELETE=23 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:31 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:31 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" returned: 0 in 0.416s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:31 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:31 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Attempting download of c305e529-0e9a-4929-bd5f-5abbee11f381 ((None, [{'url': 'file:///opt/stack/data/glance/images/c305e529-0e9a-4929-bd5f-5abbee11f381', 'metadata': {}}])) to volume d967810c-b3f8-45b8-96fd-0e35fbbb5f36. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9a7b0-b824-4bb6-9020-eb283cc938f3]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:32 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj Sep 28 18:24:32 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:32 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.413s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Deleted volume successfully. Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-cc95f7c4-aa39-4f94-9597-eaec42fe59ca tempest-VolumeDependencyTests-225654867 None] Lock "cinder-1507ef4b-cadf-4edd-bbdd-1a96dc1e9bb5-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:32 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.416s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Deleted volume successfully. Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-612c472d-af8f-4c3f-8cef-d567cd95ec0e tempest-ProjectReaderTests-2027229507 None] Lock "cinder-b9757665-124c-4c20-957d-fd71a12b87ef-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:32 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj" returned: 0 in 0.471s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:32 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj Sep 28 18:24:32 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:32 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj" returned: 1 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c305e529-0e9a-4929-bd5f-5abbee11f381_wkhluukj' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3fb82-4ff3-4b65-b208-a3ee366ab8ff]: (4, 'raw') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD Sep 28 18:24:33 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:33 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD Sep 28 18:24:33 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:33 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD" returned: 1 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:33 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] c305e529-0e9a-4929-bd5f-5abbee11f381 was raw, converting to qcow2 {{(pid=87096) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:24:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:33 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 Sep 28 18:24:33 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:34 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" returned: 0 in 0.741s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:34 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c305e529-0e9a-4929-bd5f-5abbee11f381_55hh7g_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:34 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:24:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:34 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 1G Sep 28 18:24:34 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:35 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 1G" returned: 0 in 0.465s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Downloaded image c305e529-0e9a-4929-bd5f-5abbee11f381 ((None, [{'url': 'file:///opt/stack/data/glance/images/c305e529-0e9a-4929-bd5f-5abbee11f381', 'metadata': {}}])) to volume d967810c-b3f8-45b8-96fd-0e35fbbb5f36 successfully. {{(pid=87096) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Temporary image c305e529-0e9a-4929-bd5f-5abbee11f381 for user 46384fc2f7f8410e9feb1a8361b3ffbf is deleted. {{(pid=87096) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.volume_utils [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Marking volume d967810c-b3f8-45b8-96fd-0e35fbbb5f36 as bootable. {{(pid=87096) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Copying metadata from image c305e529-0e9a-4929-bd5f-5abbee11f381 to d967810c-b3f8-45b8-96fd-0e35fbbb5f36. {{(pid=87096) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Creating volume glance metadata for volume d967810c-b3f8-45b8-96fd-0e35fbbb5f36 backed by image c305e529-0e9a-4929-bd5f-5abbee11f381 with: {'image_id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0818a0ed3a3520bdbdc730601ad7bb64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87096) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0039b549-e273-42f0-9c0e-12aa4b716827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36', 'volume_size': 1, 'image_id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c305e529-0e9a-4929-bd5f-5abbee11f381', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0818a0ed3a3520bdbdc730601ad7bb64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a309a73442434dd890da49c0d0f37e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '79dbfd88802fd468c9db7c1fb035789e5773a6c7eea93f6bc6e961f7f724b97d0ddcab9153639a070c68649b039410c9c0fce0f0624c67fc502d57a155df805a', 'id': 'c305e529-0e9a-4929-bd5f-5abbee11f381', 'created_at': datetime.datetime(2026, 9, 28, 16, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c305e529-0e9a-4929-bd5f-5abbee11f381/file', 'properties': {}}, 'image_service': }' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66eaddb-d161-40ea-894f-f5f11217353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Volume volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 (d967810c-b3f8-45b8-96fd-0e35fbbb5f36): created successfully Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66eaddb-d161-40ea-894f-f5f11217353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Flow 'volume_create_manager' (9b236933-7554-4d4e-892d-0246ab892a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-18f80b6d-0a4a-49e9-a3c9-0f81d46d9d9f tempest-VolumeImageDependencyTests-854283661 None] Created volume successfully. Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Acquiring lock "cinder-d967810c-b3f8-45b8-96fd-0e35fbbb5f36-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:35 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Lock "cinder-d967810c-b3f8-45b8-96fd-0e35fbbb5f36-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Acquiring lock "cinder-quobyte-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Lock "cinder-quobyte-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:36 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7456cf38-2dff-48ea-b2a0-c20760e4de90]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:36 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 Sep 28 18:24:36 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:36 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" returned: 0 in 0.521s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:36 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36 Sep 28 18:24:36 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Lock "cinder-quobyte-d967810c-b3f8-45b8-96fd-0e35fbbb5f36" released by "delete_volume" :: held 0.953s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Created reservations ['1f741cba-a6c7-471b-baa6-5929516c3708', '3a7871ba-bb64-4f4d-80b1-0a3af3752d6b', '61e501a4-64e0-444c-a6a0-7898ca4eb175', '1f2fcefb-4e1a-40fc-abe0-197ceb9137c0'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:37 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:37 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:37 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Deleted volume successfully. Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f7ceb174-f2d4-4c16-a55e-1bc13e46d003 tempest-VolumeImageDependencyTests-854283661 None] Lock "cinder-d967810c-b3f8-45b8-96fd-0e35fbbb5f36-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Flow 'volume_create_manager' (b439ff8d-74bc-4fac-825a-451feec86a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80e9cf9-ea75-424d-a57c-bed66bd6b208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80e9cf9-ea75-424d-a57c-bed66bd6b208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7147a557-87ea-48f4-941a-bcc6402c8080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d03feb509043b2a7e04197db1ac22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:38Z,use_quota=True,user_id='5715625e091646ee893e84a490a5a27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfeee658-8647-4288-9ed1-c9fa708471ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfeee658-8647-4288-9ed1-c9fa708471ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f03522-9b74-46e4-b26f-667427d4937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f03522-9b74-46e4-b26f-667427d4937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7147a557-87ea-48f4-941a-bcc6402c8080', 'volume_name': 'volume-7147a557-87ea-48f4-941a-bcc6402c8080', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e705e0-1329-49db-a076-5db56fcc871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e705e0-1329-49db-a076-5db56fcc871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d94741-fc13-43fa-a24e-6fa8abf0a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:37 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Volume 7147a557-87ea-48f4-941a-bcc6402c8080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7147a557-87ea-48f4-941a-bcc6402c8080', 'volume_size': 1} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7147a557-87ea-48f4-941a-bcc6402c8080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d03feb509043b2a7e04197db1ac22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:38Z,use_quota=True,user_id='5715625e091646ee893e84a490a5a27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Creating volume 7147a557-87ea-48f4-941a-bcc6402c8080 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:37 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:37 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 1073741824 Sep 28 18:24:37 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:38 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 1073741824" returned: 0 in 0.723s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:38 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 Sep 28 18:24:38 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:39 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d94741-fc13-43fa-a24e-6fa8abf0a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7147a557-87ea-48f4-941a-bcc6402c8080', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b63e7fc-c9be-44ea-8958-2761b55e067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:39 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Volume volume-7147a557-87ea-48f4-941a-bcc6402c8080 (7147a557-87ea-48f4-941a-bcc6402c8080): created successfully Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b63e7fc-c9be-44ea-8958-2761b55e067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:39 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Flow 'volume_create_manager' (b439ff8d-74bc-4fac-825a-451feec86a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:39 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-29713144-5fc9-41e4-ae1a-7acb67888ecf tempest-CinderUnicodeTest-447013864 None] Created volume successfully. Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Flow 'volume_create_manager' (49aca4a4-fad6-44ab-9a9c-a52acbf638fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78a28cf-a716-4017-a67f-2b207139f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78a28cf-a716-4017-a67f-2b207139f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-423586922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712fa85b-5009-42ac-aad7-baa0e3655d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d03feb509043b2a7e04197db1ac22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:41Z,use_quota=True,user_id='5715625e091646ee893e84a490a5a27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3283c-c782-474c-989b-b506acb5877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f3283c-c782-474c-989b-b506acb5877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2b601e-0891-4c44-95dc-86d7ee23471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2b601e-0891-4c44-95dc-86d7ee23471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712fa85b-5009-42ac-aad7-baa0e3655d92', 'volume_name': 'volume-712fa85b-5009-42ac-aad7-baa0e3655d92', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2f7f7c-1672-44cc-8ebc-57cf202362c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2f7f7c-1672-44cc-8ebc-57cf202362c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cfbb60-8dff-40bd-993e-5cc3ce21af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:40 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Volume 712fa85b-5009-42ac-aad7-baa0e3655d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712fa85b-5009-42ac-aad7-baa0e3655d92', 'volume_size': 1} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-423586922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712fa85b-5009-42ac-aad7-baa0e3655d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d03feb509043b2a7e04197db1ac22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:41Z,use_quota=True,user_id='5715625e091646ee893e84a490a5a27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Creating volume 712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:40 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:40 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 1073741824 Sep 28 18:24:40 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:41 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 1073741824" returned: 0 in 0.641s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:41 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 Sep 28 18:24:41 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:41 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92" returned: 0 in 0.323s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cfbb60-8dff-40bd-993e-5cc3ce21af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712fa85b-5009-42ac-aad7-baa0e3655d92', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e295cf-b4e7-4cca-8f75-34f73cb6400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Volume volume-712fa85b-5009-42ac-aad7-baa0e3655d92 (712fa85b-5009-42ac-aad7-baa0e3655d92): created successfully Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e295cf-b4e7-4cca-8f75-34f73cb6400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Flow 'volume_create_manager' (49aca4a4-fad6-44ab-9a9c-a52acbf638fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:41 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bb956bd4-ef9b-439e-b36e-6387a9fee9b0 tempest-CinderUnicodeTest-447013864 None] Created volume successfully. Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Creating offline snapshot 2e965ae7-aec5-464e-8b6b-a48480699ca6 of volume 712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc448062-37f8-4909-b25e-b38119d00487]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:43 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 Sep 28 18:24:43 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:43 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92" returned: 0 in 0.516s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:43 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 1G Sep 28 18:24:43 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:44 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 1G" returned: 0 in 0.665s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712fa85b-5009-42ac-aad7-baa0e3655d92 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:44 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712fa85b-5009-42ac-aad7-baa0e3655d92 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 Sep 28 18:24:44 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:44 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712fa85b-5009-42ac-aad7-baa0e3655d92 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6" returned: 0 in 0.501s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:44 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 is being set with open permissions: ugo+rw Sep 28 18:24:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:44 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 Sep 28 18:24:44 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:45 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6" returned: 0 in 0.353s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:45 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info Sep 28 18:24:45 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:45 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info" returned: 0 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:45 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info is being set with open permissions: ugo+rw Sep 28 18:24:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:45 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info Sep 28 18:24:45 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:46 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.info" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a33ec3bd-4df6-45dd-8e48-754fe9292194 tempest-CinderUnicodeTest-447013864 None] Create snapshot completed successfully Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-2e965ae7-aec5-464e-8b6b-a48480699ca6-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Lock "cinder-2e965ae7-aec5-464e-8b6b-a48480699ca6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-quobyte-712fa85b-5009-42ac-aad7-baa0e3655d92" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-712fa85b-5009-42ac-aad7-baa0e3655d92" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-quobyte-2e965ae7-aec5-464e-8b6b-a48480699ca6" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-2e965ae7-aec5-464e-8b6b-a48480699ca6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Deleting offline snapshot 2e965ae7-aec5-464e-8b6b-a48480699ca6 of volume 712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] snapshot_file for this snap is: volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff8bf8b-1994-4db1-8ebb-6a0da0752b43]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:46 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 Sep 28 18:24:46 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6" returned: 0 in 0.519s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-712fa85b-5009-42ac-aad7-baa0e3655d92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2143e280-9610-4789-b13e-93c8291e3973]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:47 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 Sep 28 18:24:47 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:47 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92" returned: 0 in 0.617s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:47 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 Sep 28 18:24:47 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:48 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:48 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6 Sep 28 18:24:48 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:48 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92.2e965ae7-aec5-464e-8b6b-a48480699ca6" returned: 0 in 0.331s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-2e965ae7-aec5-464e-8b6b-a48480699ca6" released by "_delete_snapshot" :: held 2.139s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-712fa85b-5009-42ac-aad7-baa0e3655d92" released by "delete_snapshot" :: held 2.182s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Created reservations ['15e94def-1903-4034-bb3b-71cb78346bd3', 'eaee0565-674e-4d7a-b6b5-37a2316dbb1a', '14434ef2-ad11-4c01-a743-1cba209bfd79', 'c6a0e075-8b9f-42ec-b43b-de04f290cd08'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Delete snapshot completed successfully. Sep 28 18:24:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7fa546ba-28c0-4609-9c9d-4afd33015e3a tempest-CinderUnicodeTest-447013864 None] Lock "cinder-2e965ae7-aec5-464e-8b6b-a48480699ca6-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-712fa85b-5009-42ac-aad7-baa0e3655d92-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Lock "cinder-712fa85b-5009-42ac-aad7-baa0e3655d92-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-quobyte-712fa85b-5009-42ac-aad7-baa0e3655d92" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-712fa85b-5009-42ac-aad7-baa0e3655d92" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c3af8-1994-44a4-b892-8a05017be925]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:50 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 Sep 28 18:24:50 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:50 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:50 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92 Sep 28 18:24:50 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:50 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-712fa85b-5009-42ac-aad7-baa0e3655d92" returned: 0 in 0.325s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-712fa85b-5009-42ac-aad7-baa0e3655d92" released by "delete_volume" :: held 0.956s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:50 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Created reservations ['d4347f39-477e-478a-ad33-96ca1a6ac3d0', 'f4c2a56f-0b55-4785-898c-dc3c39bc4718', '6266d1fe-291f-4e96-a1a4-059e29347aaa', '76c39685-4474-4173-b4df-3b603737a4e8'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:51 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:51 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:51 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.352s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Deleted volume successfully. Sep 28 18:24:51 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-264ac63c-8d30-4c67-9501-792f9249a557 tempest-CinderUnicodeTest-447013864 None] Lock "cinder-712fa85b-5009-42ac-aad7-baa0e3655d92-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-7147a557-87ea-48f4-941a-bcc6402c8080-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Lock "cinder-7147a557-87ea-48f4-941a-bcc6402c8080-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Acquiring lock "cinder-quobyte-7147a557-87ea-48f4-941a-bcc6402c8080" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-7147a557-87ea-48f4-941a-bcc6402c8080" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d9bf3a-e918-45bd-99ed-8119c20a88bc]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (b9e8055d-7fd2-4525-b93d-2068bc5d8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e682fe-cdea-43bf-8b7c-b88596dd6d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e682fe-cdea-43bf-8b7c-b88596dd6d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599201749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85b4430-2178-4968-b1e6-67d70f723284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:52Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0101c6c-0b9c-4ed2-a17d-725b6ae172db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0101c6c-0b9c-4ed2-a17d-725b6ae172db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86f08d8-959b-4718-a992-3fffb9cafa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86f08d8-959b-4718-a992-3fffb9cafa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85b4430-2178-4968-b1e6-67d70f723284', 'volume_name': 'volume-b85b4430-2178-4968-b1e6-67d70f723284', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5260f53e-9664-4265-9607-680f6c6071b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:52 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 Sep 28 18:24:52 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5260f53e-9664-4265-9607-680f6c6071b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb42916-7c52-4106-8281-eea109a4551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:52 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Volume b85b4430-2178-4968-b1e6-67d70f723284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85b4430-2178-4968-b1e6-67d70f723284', 'volume_size': 1} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599201749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85b4430-2178-4968-b1e6-67d70f723284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:52Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Creating volume b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:52 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 1073741824 Sep 28 18:24:52 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:52 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080" returned: 0 in 0.468s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:52 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080 Sep 28 18:24:52 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 1073741824" returned: 0 in 0.536s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 Sep 28 18:24:53 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-7147a557-87ea-48f4-941a-bcc6402c8080" returned: 0 in 0.339s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Lock "cinder-quobyte-7147a557-87ea-48f4-941a-bcc6402c8080" released by "delete_volume" :: held 0.911s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Created reservations ['1153bdba-09e1-4006-a8d5-f7dc2a2f34f9', 'd347fd94-d5fc-4ab8-94bc-e9e4b009eeab', 'e3eb6211-5c9f-4637-ba9d-1e6ad421c3ba', 'ecd983a1-a5e9-4df2-9553-1862be0363dc'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:53 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284" returned: 0 in 0.352s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:53 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:24:53 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb42916-7c52-4106-8281-eea109a4551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85b4430-2178-4968-b1e6-67d70f723284', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34ca750-c739-4a8b-8f13-c959dfaee341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:53 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Volume volume-b85b4430-2178-4968-b1e6-67d70f723284 (b85b4430-2178-4968-b1e6-67d70f723284): created successfully Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34ca750-c739-4a8b-8f13-c959dfaee341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (b9e8055d-7fd2-4525-b93d-2068bc5d8836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-66041ba6-293b-46c3-b5e7-4899ce4acc1c tempest-ProjectReaderTests-17970903 None] Created volume successfully. Sep 28 18:24:53 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.321s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:53 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Deleted volume successfully. Sep 28 18:24:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-08f8d9a4-85e8-444d-a128-1995be9211ad tempest-CinderUnicodeTest-447013864 None] Lock "cinder-7147a557-87ea-48f4-941a-bcc6402c8080-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:24:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:54 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Creating offline snapshot 4586029c-d409-4778-820d-3288087dd4dc of volume b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:24:54 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0572eb9e-0797-4165-8989-3c6ae067bea4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 Sep 28 18:24:55 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:55 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284" returned: 0 in 0.488s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:55 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc 1G Sep 28 18:24:55 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:56 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc 1G" returned: 0 in 0.564s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85b4430-2178-4968-b1e6-67d70f723284 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:56 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85b4430-2178-4968-b1e6-67d70f723284 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc Sep 28 18:24:56 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:56 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85b4430-2178-4968-b1e6-67d70f723284 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc" returned: 0 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:56 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc is being set with open permissions: ugo+rw Sep 28 18:24:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:56 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc Sep 28 18:24:56 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:56 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc" returned: 0 in 0.485s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info Sep 28 18:24:57 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info" returned: 0 in 0.357s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info is being set with open permissions: ugo+rw Sep 28 18:24:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:57 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info Sep 28 18:24:57 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:57 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.info" returned: 0 in 0.386s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.920s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:57 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-81543205-124d-406f-ac7b-4d2eef22c03b tempest-ProjectReaderTests-17970903 None] Create snapshot completed successfully Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-4586029c-d409-4778-820d-3288087dd4dc-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Lock "cinder-4586029c-d409-4778-820d-3288087dd4dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-b85b4430-2178-4968-b1e6-67d70f723284" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-b85b4430-2178-4968-b1e6-67d70f723284" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-4586029c-d409-4778-820d-3288087dd4dc" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-4586029c-d409-4778-820d-3288087dd4dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Deleting offline snapshot 4586029c-d409-4778-820d-3288087dd4dc of volume b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] snapshot_file for this snap is: volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[670c3eb1-2884-4388-88f5-b896adbcbf1d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:58 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc Sep 28 18:24:58 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc" returned: 0 in 0.551s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85b4430-2178-4968-b1e6-67d70f723284(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:24:59 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[56140c41-6a77-4d39-b975-ffa2936a04e8]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 Sep 28 18:24:59 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:59 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284" returned: 0 in 0.545s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:59 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc Sep 28 18:24:59 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc" returned: 0 in 0.477s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc Sep 28 18:25:00 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (9dc8dc27-ace2-4cf0-bd69-2a46b96dfe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680022b3-0588-4ea3-b69e-ed227fe59f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680022b3-0588-4ea3-b69e-ed227fe59f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566266270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8db359-256f-4fa7-a07a-7439ab37ccc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:00Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9492dc4-d9f0-40df-8946-5dc497c5dfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9492dc4-d9f0-40df-8946-5dc497c5dfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905b6fbd-ad85-433a-9348-f8b83b46bc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905b6fbd-ad85-433a-9348-f8b83b46bc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8db359-256f-4fa7-a07a-7439ab37ccc5', 'volume_name': 'volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01162069-2143-47ce-98d8-27d9dd7132cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01162069-2143-47ce-98d8-27d9dd7132cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8121e60-b254-4187-a792-fecedccf7d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:00 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Volume fa8db359-256f-4fa7-a07a-7439ab37ccc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5', 'volume_size': 1} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566266270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8db359-256f-4fa7-a07a-7439ab37ccc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:00Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Creating volume fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:00 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:00 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 1073741824 Sep 28 18:25:00 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:00 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284.4586029c-d409-4778-820d-3288087dd4dc" returned: 0 in 0.366s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-4586029c-d409-4778-820d-3288087dd4dc" released by "_delete_snapshot" :: held 2.119s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-b85b4430-2178-4968-b1e6-67d70f723284" released by "delete_snapshot" :: held 2.146s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Created reservations ['250eb73f-6250-4d85-8b91-bf5c9c2419f1', 'a3b3ed62-0190-4dda-ab23-ee7bff2e3915', '6627947f-744d-4997-b8ce-bee5e31a50f6', '81446066-6412-4cb1-b4b3-8bf0bdf6d9ba'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:00 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Delete snapshot completed successfully. Sep 28 18:25:00 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e44ed2fc-9fcb-41f7-a61f-2fbffd9ee58b tempest-ProjectReaderTests-17970903 None] Lock "cinder-4586029c-d409-4778-820d-3288087dd4dc-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:01 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 1073741824" returned: 0 in 0.609s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:01 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 Sep 28 18:25:01 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:01 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5" returned: 0 in 0.348s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8121e60-b254-4187-a792-fecedccf7d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56f0c3f-5fae-4b84-a71c-ba6903c4efe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:01 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Volume volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 (fa8db359-256f-4fa7-a07a-7439ab37ccc5): created successfully Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56f0c3f-5fae-4b84-a71c-ba6903c4efe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (9dc8dc27-ace2-4cf0-bd69-2a46b96dfe06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2fca6836-79f1-4c64-8cde-8c3d9dcb30e6 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-b85b4430-2178-4968-b1e6-67d70f723284-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Lock "cinder-b85b4430-2178-4968-b1e6-67d70f723284-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-b85b4430-2178-4968-b1e6-67d70f723284" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:01 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-b85b4430-2178-4968-b1e6-67d70f723284" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbacbd7-8057-4ba9-a65f-0180aaf9ec7c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:02 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 Sep 28 18:25:02 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:02 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:02 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284 Sep 28 18:25:02 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:02 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-b85b4430-2178-4968-b1e6-67d70f723284" returned: 0 in 0.392s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:02 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-b85b4430-2178-4968-b1e6-67d70f723284" released by "delete_volume" :: held 0.998s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Created reservations ['933950c1-7f47-48ec-9e3b-5487634e24e7', '7f903b6c-3f58-44a8-8c03-a931b15fc687', '52f4bbb9-7415-4779-a684-e8825a76c861', 'ad55845f-a83a-4ee0-a787-cf122c94d5a1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:03 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:03 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Flow 'volume_create_manager' (7d0d7afb-2f91-4929-81cc-b9cfc0a81199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba87ba6f-ff88-4881-9bbe-1471c905f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Creating offline snapshot ec430194-45fd-4b25-8fc8-b5a09c0cb665 of volume fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba87ba6f-ff88-4881-9bbe-1471c905f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-894372041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd22c542-9876-496e-8907-b18a9317f446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b358a60194ab88035c2b551fe9abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:03Z,use_quota=True,user_id='29d6f2695cb74c489a266094c6f9fbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2494939-98d1-43ba-a002-c87d35c0735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2494939-98d1-43ba-a002-c87d35c0735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90aee5d9-2c88-424e-bf16-cc8bd8b5c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90aee5d9-2c88-424e-bf16-cc8bd8b5c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd22c542-9876-496e-8907-b18a9317f446', 'volume_name': 'volume-dd22c542-9876-496e-8907-b18a9317f446', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7cf1dc-a8c2-47b8-bf0e-c5e943477762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7cf1dc-a8c2-47b8-bf0e-c5e943477762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279822e-c295-424e-9c2c-cfc48e4608a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:03 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Volume dd22c542-9876-496e-8907-b18a9317f446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd22c542-9876-496e-8907-b18a9317f446', 'volume_size': 1} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d666aaf-587f-4122-9f1f-f5b045566398]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:03 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 Sep 28 18:25:03 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:03 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.302s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:03 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Deleted volume successfully. Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6c041aa9-4bfa-4c08-b6df-c9d9a9b8e265 tempest-ProjectReaderTests-17970903 None] Lock "cinder-b85b4430-2178-4968-b1e6-67d70f723284-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:03 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5" returned: 0 in 0.493s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:03 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 1G Sep 28 18:25:03 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:04 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 1G" returned: 0 in 0.581s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:04 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 Sep 28 18:25:04 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:04 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (731e70b5-3a69-4863-a592-ef738d6013a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc54f72a-53cc-4953-b822-09e10194c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665" returned: 0 in 0.443s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:04 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 is being set with open permissions: ugo+rw Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:04 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 Sep 28 18:25:04 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc54f72a-53cc-4953-b822-09e10194c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691706694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9ead36-eaf8-4433-9898-fd0c14a1ebf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:05Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0fae59-9bda-4f6c-8d12-32999a84d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0fae59-9bda-4f6c-8d12-32999a84d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e21c6b-ed41-4d6a-8064-16d81ee374bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e21c6b-ed41-4d6a-8064-16d81ee374bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9ead36-eaf8-4433-9898-fd0c14a1ebf2', 'volume_name': 'volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5a0755-9b02-411b-ade1-f0cf3e4cd528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5a0755-9b02-411b-ade1-f0cf3e4cd528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122e438a-b1f4-4bf8-8afa-2d714b199c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:04 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Volume da9ead36-eaf8-4433-9898-fd0c14a1ebf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2', 'volume_size': 1} Sep 28 18:25:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:05 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665" returned: 0 in 0.286s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:05 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info Sep 28 18:25:05 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:05 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info" returned: 0 in 0.291s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:05 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info is being set with open permissions: ugo+rw Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:05 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info Sep 28 18:25:05 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:05 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.info" returned: 0 in 0.305s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-894372041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd22c542-9876-496e-8907-b18a9317f446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b358a60194ab88035c2b551fe9abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:03Z,use_quota=True,user_id='29d6f2695cb74c489a266094c6f9fbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Creating volume dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:05 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:05 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 1073741824 Sep 28 18:25:05 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:05 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-afeda094-ab1d-4a2a-834e-8493deb26d0e tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-ec430194-45fd-4b25-8fc8-b5a09c0cb665-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Lock "cinder-ec430194-45fd-4b25-8fc8-b5a09c0cb665-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-fa8db359-256f-4fa7-a07a-7439ab37ccc5" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fa8db359-256f-4fa7-a07a-7439ab37ccc5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-ec430194-45fd-4b25-8fc8-b5a09c0cb665" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-ec430194-45fd-4b25-8fc8-b5a09c0cb665" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot ec430194-45fd-4b25-8fc8-b5a09c0cb665 of volume fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f94ad9-e80f-46dd-b2c7-342f4b2b4655]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:06 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 1073741824" returned: 0 in 0.567s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:06 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 Sep 28 18:25:06 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:06 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 Sep 28 18:25:06 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:06 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446" returned: 0 in 0.286s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691706694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9ead36-eaf8-4433-9898-fd0c14a1ebf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:05Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Creating volume da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:06 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:06 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665" returned: 0 in 0.478s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:06 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 1073741824 Sep 28 18:25:06 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6279822e-c295-424e-9c2c-cfc48e4608a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd22c542-9876-496e-8907-b18a9317f446', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384127c4-852e-43f6-918f-81286a2ea549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f66f9-6cc3-49cf-ab82-ea66e219913b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:06 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Volume volume-dd22c542-9876-496e-8907-b18a9317f446 (dd22c542-9876-496e-8907-b18a9317f446): created successfully Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384127c4-852e-43f6-918f-81286a2ea549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:06 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Flow 'volume_create_manager' (7d0d7afb-2f91-4929-81cc-b9cfc0a81199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:06 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2d4d1912-5a49-4da0-9493-75dae34347e1 tempest-SnapshotDependencyTests-964879589 None] Created volume successfully. Sep 28 18:25:06 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 Sep 28 18:25:06 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:07 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5" returned: 0 in 0.464s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:07 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 1073741824" returned: 0 in 0.557s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:07 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 Sep 28 18:25:07 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:07 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 Sep 28 18:25:07 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:07 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" returned: 0 in 0.334s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122e438a-b1f4-4bf8-8afa-2d714b199c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c451422-bedf-48fc-8e9f-85fa0d759484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Creating offline snapshot 5cd8d4e3-27ab-4c84-a763-ec6e733b323c of volume dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:07 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Volume volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 (da9ead36-eaf8-4433-9898-fd0c14a1ebf2): created successfully Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c451422-bedf-48fc-8e9f-85fa0d759484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:07 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (731e70b5-3a69-4863-a592-ef738d6013a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bbd049-4757-4eb1-b2f6-8c8c749ec324]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-79fdf4b9-24f1-466e-a2bf-b243c9c275c9 tempest-ProjectReaderTests-17970903 None] Created volume successfully. Sep 28 18:25:07 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665 Sep 28 18:25:07 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:07 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 Sep 28 18:25:07 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:08 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5.ec430194-45fd-4b25-8fc8-b5a09c0cb665" returned: 0 in 0.295s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-ec430194-45fd-4b25-8fc8-b5a09c0cb665" released by "_delete_snapshot" :: held 1.901s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fa8db359-256f-4fa7-a07a-7439ab37ccc5" released by "delete_snapshot" :: held 1.933s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Created reservations ['f4633c38-d1d2-4357-8fb8-5a236138de33', '5a61b24b-3c4f-481e-b017-7ccff02701d4', '4988ee9d-d196-4558-8341-1d926a8cccf9', '7d72453f-8f37-4fd4-8d24-ad8fb92eb7f1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:08 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446" returned: 0 in 0.485s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:08 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c 1G Sep 28 18:25:08 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:08 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-c6ac4051-70af-4009-89e1-c50cffe21493 tempest-ProjectMemberTests-819848877 None] Lock "cinder-ec430194-45fd-4b25-8fc8-b5a09c0cb665-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:08 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c 1G" returned: 0 in 0.500s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd22c542-9876-496e-8907-b18a9317f446 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:08 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd22c542-9876-496e-8907-b18a9317f446 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c Sep 28 18:25:08 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:09 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd22c542-9876-496e-8907-b18a9317f446 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c" returned: 0 in 0.351s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:09 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c is being set with open permissions: ugo+rw Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:09 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c Sep 28 18:25:09 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:09 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-fa8db359-256f-4fa7-a07a-7439ab37ccc5-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c" returned: 0 in 0.290s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Lock "cinder-fa8db359-256f-4fa7-a07a-7439ab37ccc5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-fa8db359-256f-4fa7-a07a-7439ab37ccc5" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:09 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info Sep 28 18:25:09 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fa8db359-256f-4fa7-a07a-7439ab37ccc5" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb265d5-25fb-4d2f-81c5-9f5c4a237929]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:09 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 Sep 28 18:25:09 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:09 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info" returned: 0 in 0.294s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:09 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info is being set with open permissions: ugo+rw Sep 28 18:25:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:09 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info Sep 28 18:25:09 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5" returned: 0 in 0.434s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:10 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5 Sep 28 18:25:10 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.info" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.905s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Creating offline snapshot 85b54999-da67-4248-9400-730c7ce73ef5 of volume da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-925bbb3d-e4b8-46d4-8a9c-26ecf20c3c73 tempest-SnapshotDependencyTests-964879589 None] Create snapshot completed successfully Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[de74d7d7-4396-4fa9-b04c-35894e8011c5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:10 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 Sep 28 18:25:10 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fa8db359-256f-4fa7-a07a-7439ab37ccc5" returned: 0 in 0.300s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fa8db359-256f-4fa7-a07a-7439ab37ccc5" released by "delete_volume" :: held 0.805s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Created reservations ['8a023763-efb2-4426-b78a-04ff7f3c6576', 'bde70f21-2f96-4645-92ed-3fbed57bac8b', '240b71a7-24b8-44cb-b62f-21e809b23d74', '2fa4a866-f207-4dee-9269-03ec7bfb6f67'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:10 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:10 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" returned: 0 in 0.474s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:10 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 1G Sep 28 18:25:10 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:10 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.322s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:25:10 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-80f1f045-ce0a-461b-b01d-07e0feadf2e6 tempest-ProjectMemberTests-819848877 None] Lock "cinder-fa8db359-256f-4fa7-a07a-7439ab37ccc5-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (776a029c-5d67-4fb7-b4d0-b4a349c32267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd4acba-4d63-4d6a-a509-59193c6612de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd4acba-4d63-4d6a-a509-59193c6612de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112530825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:11Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1b618-e453-481e-9d1c-2b106c2a0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1b618-e453-481e-9d1c-2b106c2a0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abad4af-866b-405d-a0c8-2d27b8f54965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abad4af-866b-405d-a0c8-2d27b8f54965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6', 'volume_name': 'volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b9c534-3373-4aa1-b790-d0c9d7730fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b9c534-3373-4aa1-b790-d0c9d7730fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df46e0b4-bc69-46b3-a4d4-aa767fb02896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Volume fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6', 'volume_size': 1} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 1G" returned: 0 in 0.706s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 Sep 28 18:25:11 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:11 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5" returned: 0 in 0.409s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:11 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 is being set with open permissions: ugo+rw Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:11 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 Sep 28 18:25:11 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Flow 'volume_create_manager' (3f540035-2ef1-4fe7-9f4e-5149dc9f1d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426a8b0a-2e6e-4971-b0bc-9b85cd0c80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426a8b0a-2e6e-4971-b0bc-9b85cd0c80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e314eaf-f8ac-4d15-abc3-cc284903366f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac7b358a60194ab88035c2b551fe9abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5cd8d4e3-27ab-4c84-a763-ec6e733b323c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:12Z,use_quota=True,user_id='29d6f2695cb74c489a266094c6f9fbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d5b09-8106-4c6a-ac08-62302284f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d5b09-8106-4c6a-ac08-62302284f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7102ebbe-a715-4cfd-baea-95cfdaf7dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7102ebbe-a715-4cfd-baea-95cfdaf7dc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e314eaf-f8ac-4d15-abc3-cc284903366f', 'volume_name': 'volume-3e314eaf-f8ac-4d15-abc3-cc284903366f', 'volume_size': 1, 'snapshot_id': '5cd8d4e3-27ab-4c84-a763-ec6e733b323c'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb43e36-65ab-42b1-9f9d-ca36d71bcfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb43e36-65ab-42b1-9f9d-ca36d71bcfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd223cb7-7896-4410-b41f-13cb2bd752b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:11 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Volume 3e314eaf-f8ac-4d15-abc3-cc284903366f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e314eaf-f8ac-4d15-abc3-cc284903366f', 'volume_size': 1, 'snapshot_id': '5cd8d4e3-27ab-4c84-a763-ec6e733b323c'} Sep 28 18:25:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:12 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info Sep 28 18:25:12 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info" returned: 0 in 0.343s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info is being set with open permissions: ugo+rw Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info Sep 28 18:25:12 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.info" returned: 0 in 0.298s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112530825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:11Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Creating volume fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:12 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:12 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 1073741824 Sep 28 18:25:12 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:12 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-40f4bc13-71d2-4a88-b264-344b8f98bf6b tempest-ProjectReaderTests-17970903 None] Create snapshot completed successfully Sep 28 18:25:13 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 1073741824" returned: 0 in 0.526s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:13 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 Sep 28 18:25:13 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-85b54999-da67-4248-9400-730c7ce73ef5-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Lock "cinder-85b54999-da67-4248-9400-730c7ce73ef5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-85b54999-da67-4248-9400-730c7ce73ef5" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-85b54999-da67-4248-9400-730c7ce73ef5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Deleting offline snapshot 85b54999-da67-4248-9400-730c7ce73ef5 of volume da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] snapshot_file for this snap is: volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13880b6-4488-475b-839b-7867eaae8c82]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:13 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" returned: 0 in 0.348s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.800s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-quobyte-5cd8d4e3-27ab-4c84-a763-ec6e733b323c-3e314eaf-f8ac-4d15-abc3-cc284903366f" by "_create_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df46e0b4-bc69-46b3-a4d4-aa767fb02896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f409320f-2c36-4325-ae39-9f7663d777fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:13 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 Sep 28 18:25:13 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-5cd8d4e3-27ab-4c84-a763-ec6e733b323c-3e314eaf-f8ac-4d15-abc3-cc284903366f" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Creating volume 3e314eaf-f8ac-4d15-abc3-cc284903366f from snapshot 5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-quobyte-3e314eaf-f8ac-4d15-abc3-cc284903366f" by "_copy_volume_from_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:13 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Volume volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 (fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6): created successfully Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f409320f-2c36-4325-ae39-9f7663d777fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (776a029c-5d67-4fb7-b4d0-b4a349c32267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-3e314eaf-f8ac-4d15-abc3-cc284903366f" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] snapshot: 5cd8d4e3-27ab-4c84-a763-ec6e733b323c, volume: 3e314eaf-f8ac-4d15-abc3-cc284903366f, {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:25:13 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7b55e9e9-04e3-4c21-bb14-3bd038d052c6 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dfb3db-fd05-444c-aef3-90ac6bc1110d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:14 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c Sep 28 18:25:14 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:14 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5" returned: 0 in 0.506s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e40193-f1ac-46fe-85c7-66af945a793d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:14 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 Sep 28 18:25:14 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:14 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd22c542-9876-496e-8907-b18a9317f446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9023d228-8522-43ba-bd16-0426a362dd07]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:14 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 Sep 28 18:25:14 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:14 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" returned: 0 in 0.550s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:14 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 Sep 28 18:25:14 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:14 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446" returned: 0 in 0.484s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Creating direct copy from snapshot {{(pid=87096) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG cinder.utils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Path /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f not found in is_blk_device check {{(pid=87096) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:25:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:14 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f Sep 28 18:25:14 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:15 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5" returned: 0 in 0.453s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:15 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5 Sep 28 18:25:15 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:15 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2.85b54999-da67-4248-9400-730c7ce73ef5" returned: 0 in 0.356s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-85b54999-da67-4248-9400-730c7ce73ef5" released by "_delete_snapshot" :: held 2.064s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" released by "delete_snapshot" :: held 2.105s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Created reservations ['cf4bde75-6e04-4a70-93af-632010d8bf38', '9e38f8a3-ed36-4959-b358-8e56793e7eb0', 'c37165d1-e736-4515-b605-319f146b090b', '554c7848-e3a8-4fba-bb49-bdf590b3b03e'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:15 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Delete snapshot completed successfully. Sep 28 18:25:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-90e4dba8-3998-42df-8870-7317de64017e tempest-ProjectReaderTests-17970903 None] Lock "cinder-85b54999-da67-4248-9400-730c7ce73ef5-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-da9ead36-eaf8-4433-9898-fd0c14a1ebf2-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Lock "cinder-da9ead36-eaf8-4433-9898-fd0c14a1ebf2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" acquired by "delete_volume" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64674c0-2d15-41df-9fcf-f31e0d328253]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:17 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 Sep 28 18:25:17 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:17 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" returned: 0 in 0.595s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:17 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2 Sep 28 18:25:17 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:18 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" returned: 0 in 0.572s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-da9ead36-eaf8-4433-9898-fd0c14a1ebf2" released by "delete_volume" :: held 1.338s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Created reservations ['fb4d8c92-6950-409e-bde6-54627ddda5a5', '6e15696f-8f30-4fc4-9a1b-09159ab83d00', '49653e0d-18c4-4baf-8454-be66390cce43', '9521ad52-dfa7-4932-b9e0-9f407ee11ea1'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:18 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:18 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:19 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.583s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:19 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:19 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Deleted volume successfully. Sep 28 18:25:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-7a31d9c4-f5c2-4c3a-8378-be0ebeeab0d7 tempest-ProjectReaderTests-17970903 None] Lock "cinder-da9ead36-eaf8-4433-9898-fd0c14a1ebf2-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (2844200d-d91b-4fb1-948e-07c22ae2d12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4ae7b6-bbe4-4175-92d6-baff55f8f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4ae7b6-bbe4-4175-92d6-baff55f8f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-271593050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a764842-e8d8-40dd-8d48-b2c827dc0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:20Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64b913e-3127-400a-96d0-2a256d99744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64b913e-3127-400a-96d0-2a256d99744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e9ec34-9b13-45d6-a109-fbf6d1c4109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e9ec34-9b13-45d6-a109-fbf6d1c4109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a764842-e8d8-40dd-8d48-b2c827dc0c17', 'volume_name': 'volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c6cc7f-6de5-4448-8608-2411a5434168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c6cc7f-6de5-4448-8608-2411a5434168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba679435-816b-4de3-9334-14db4af3e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:20 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Volume 1a764842-e8d8-40dd-8d48-b2c827dc0c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17', 'volume_size': 1} Sep 28 18:25:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:22 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f" returned: 0 in 7.377s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.image.image_utils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Image conversion details: src /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f {{(pid=87096) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:25:22 devstack cinder-volume[87096]: INFO cinder.image.image_utils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Converted 1024.00 MB image at 138.79 MB/s Sep 28 18:25:22 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f is being set with open permissions: ugo+rw Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:22 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f Sep 28 18:25:22 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:22 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f" returned: 0 in 0.269s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-3e314eaf-f8ac-4d15-abc3-cc284903366f" released by "_copy_volume_from_snapshot" :: held 8.753s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-5cd8d4e3-27ab-4c84-a763-ec6e733b323c-3e314eaf-f8ac-4d15-abc3-cc284903366f" released by "_create_volume_from_snapshot" :: held 8.859s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.898s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.954s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Creating offline snapshot c0c95c32-11af-4e1c-8457-894f50ae2077 of volume fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd223cb7-7896-4410-b41f-13cb2bd752b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e314eaf-f8ac-4d15-abc3-cc284903366f', 'volume_size': 1, 'snapshot_id': '5cd8d4e3-27ab-4c84-a763-ec6e733b323c'}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542a80b1-b44c-4315-bd17-41f0272f1143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459dba0-596a-4cec-9056-eb598a8b6583]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:22 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Volume volume-3e314eaf-f8ac-4d15-abc3-cc284903366f (3e314eaf-f8ac-4d15-abc3-cc284903366f): created successfully Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542a80b1-b44c-4315-bd17-41f0272f1143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:22 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Flow 'volume_create_manager' (3f540035-2ef1-4fe7-9f4e-5149dc9f1d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:22 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a7f10b74-8045-4327-be4a-f943ace0f220 tempest-SnapshotDependencyTests-964879589 None] Created volume successfully. Sep 28 18:25:22 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 Sep 28 18:25:22 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:23 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:23 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 1G Sep 28 18:25:23 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:23 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 1G" returned: 0 in 0.457s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:23 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 Sep 28 18:25:23 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:23 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:23 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-5cd8d4e3-27ab-4c84-a763-ec6e733b323c-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:23 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077" returned: 0 in 0.381s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:23 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 is being set with open permissions: ugo+rw Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-5cd8d4e3-27ab-4c84-a763-ec6e733b323c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-quobyte-dd22c542-9876-496e-8907-b18a9317f446" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:23 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 Sep 28 18:25:23 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-dd22c542-9876-496e-8907-b18a9317f446" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-quobyte-5cd8d4e3-27ab-4c84-a763-ec6e733b323c" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-5cd8d4e3-27ab-4c84-a763-ec6e733b323c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Deleting offline snapshot 5cd8d4e3-27ab-4c84-a763-ec6e733b323c of volume dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] snapshot_file for this snap is: volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1456d84-da5f-4353-b48a-bfbc5d86c728]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.405s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:24 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c Sep 28 18:25:24 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:25:24 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077" returned: 0 in 0.320s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=128,cinder:DELETE=16,cinder:INSERT=40,cinder:UPDATE=151 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info Sep 28 18:25:24 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c" returned: 0 in 0.443s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd22c542-9876-496e-8907-b18a9317f446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77dba0-47a3-4407-b78a-1b3cb0159267]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info" returned: 0 in 0.344s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info is being set with open permissions: ugo+rw Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info Sep 28 18:25:24 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 Sep 28 18:25:24 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.info" returned: 0 in 0.300s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.655s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-271593050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a764842-e8d8-40dd-8d48-b2c827dc0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:20Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Creating volume 1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:24 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:24 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 1073741824 Sep 28 18:25:24 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-58af5887-26f7-4e07-9de0-5ca63f48955f tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:25:25 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446" returned: 0 in 0.662s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c Sep 28 18:25:25 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-c0c95c32-11af-4e1c-8457-894f50ae2077-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Lock "cinder-c0c95c32-11af-4e1c-8457-894f50ae2077-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-c0c95c32-11af-4e1c-8457-894f50ae2077" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-c0c95c32-11af-4e1c-8457-894f50ae2077" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot c0c95c32-11af-4e1c-8457-894f50ae2077 of volume fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7eb71c-0c0d-48ca-9501-8a34f213ba91]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 Sep 28 18:25:25 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 1073741824" returned: 0 in 0.605s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c" returned: 0 in 0.459s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 Sep 28 18:25:25 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c Sep 28 18:25:25 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:25 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077" returned: 0 in 0.471s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f9eea-aae4-4064-a75a-762d7bb686da]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:25 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba679435-816b-4de3-9334-14db4af3e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1644a0-b699-4408-9809-a623162a29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:25 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Volume volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 (1a764842-e8d8-40dd-8d48-b2c827dc0c17): created successfully Sep 28 18:25:25 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1644a0-b699-4408-9809-a623162a29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (2844200d-d91b-4fb1-948e-07c22ae2d12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446.5cd8d4e3-27ab-4c84-a763-ec6e733b323c" returned: 0 in 0.350s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:25 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d48b166c-f9a4-46c1-989e-82f1f5e26919 tempest-ProjectReaderTests-17970903 None] Created volume successfully. Sep 28 18:25:25 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 Sep 28 18:25:25 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-5cd8d4e3-27ab-4c84-a763-ec6e733b323c" released by "_delete_snapshot" :: held 2.062s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-dd22c542-9876-496e-8907-b18a9317f446" released by "delete_snapshot" :: held 2.091s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Created reservations ['c701d1b1-d696-4477-91c4-9ed928493de6', '5c86536f-1684-4bcf-a939-7edcfae23499', 'ef699aa5-d15a-42ff-ae5a-92ccdf61e0f3', 'c71d2141-91b5-48f9-804b-71432925055f'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Delete snapshot completed successfully. Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ab0a828e-c5b8-4102-93d8-cc709b15b675 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-5cd8d4e3-27ab-4c84-a763-ec6e733b323c-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:26 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" returned: 0 in 0.466s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:26 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 Sep 28 18:25:26 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:26 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077" returned: 0 in 0.379s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:26 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077 Sep 28 18:25:26 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Creating offline snapshot 7be23518-2050-416a-860e-eddf94a00942 of volume 1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e33d09-a17e-4dab-b09b-da67f895f231]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:26 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6.c0c95c32-11af-4e1c-8457-894f50ae2077" returned: 0 in 0.298s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:26 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 Sep 28 18:25:26 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-c0c95c32-11af-4e1c-8457-894f50ae2077" released by "_delete_snapshot" :: held 1.758s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" released by "delete_snapshot" :: held 1.790s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Created reservations ['336b06f7-3d5e-40fb-ae4f-bb64f96a26e7', 'cc3c53be-31e8-49ac-8788-faf529879ddb', 'f42e0e7b-386e-467f-99a6-5797f834d5bb', '968de1ac-7444-4403-9f39-c7830e263546'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-dd22c542-9876-496e-8907-b18a9317f446-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-dd22c542-9876-496e-8907-b18a9317f446-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-quobyte-dd22c542-9876-496e-8907-b18a9317f446" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:27 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-dd22c542-9876-496e-8907-b18a9317f446" acquired by "delete_volume" :: waited 0.032s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-e426e309-0326-492d-a36b-bd47c591c5e7 tempest-ProjectMemberTests-819848877 None] Lock "cinder-c0c95c32-11af-4e1c-8457-894f50ae2077-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7a527-b69e-4530-baad-333cbdde470d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17" returned: 0 in 0.549s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 1G Sep 28 18:25:27 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:27 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 Sep 28 18:25:27 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Lock "cinder-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e48bb-7d43-4526-8189-396229b98311]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 Sep 28 18:25:27 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446" returned: 0 in 0.556s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:27 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446 Sep 28 18:25:27 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:27 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 1G" returned: 0 in 0.589s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 Sep 28 18:25:28 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" returned: 0 in 0.534s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6 Sep 28 18:25:28 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-dd22c542-9876-496e-8907-b18a9317f446" returned: 0 in 0.339s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-dd22c542-9876-496e-8907-b18a9317f446" released by "delete_volume" :: held 0.989s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Created reservations ['7a925ab3-c193-4338-93e0-1ac94fa35cc2', '358b3e87-590f-40c0-ae65-26d81bfa954b', 'f7fc70de-445e-4f7e-9e6a-24c70698df45', '58cbdcbd-cbcd-4b7d-a91a-9d4bb86ee3d5'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:28 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942" returned: 0 in 0.419s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 is being set with open permissions: ugo+rw Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 Sep 28 18:25:28 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:28 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" returned: 0 in 0.342s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6" released by "delete_volume" :: held 0.981s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Created reservations ['cc3445e0-9111-46c1-8dfc-bd484fc25b64', 'ec25d766-813a-41ca-b5fd-8d33435aa73e', '8c3b4ab0-ccfc-4ed6-a243-a6ba15df93df', '5f133026-9a50-4b11-ab84-d612e8c609ce'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942" returned: 0 in 0.370s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:28 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.362s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:28 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Deleted volume successfully. Sep 28 18:25:28 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info Sep 28 18:25:28 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eb8f155b-a25b-41c0-93f4-70030d526977 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-dd22c542-9876-496e-8907-b18a9317f446-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:29 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.321s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-692dbb96-0103-4aa3-b9a6-4cc18d01c670 tempest-ProjectMemberTests-819848877 None] Lock "cinder-fe12a7a2-e52d-4e11-aa28-ee67a1ec45a6-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:29 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info" returned: 0 in 0.305s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:29 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info is being set with open permissions: ugo+rw Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:29 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info Sep 28 18:25:29 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:29 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.info" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-d6a291b3-c2a0-4f9a-a5aa-30b5d5731b44 tempest-ProjectReaderTests-17970903 None] Create snapshot completed successfully Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-3e314eaf-f8ac-4d15-abc3-cc284903366f-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-3e314eaf-f8ac-4d15-abc3-cc284903366f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "cinder-quobyte-3e314eaf-f8ac-4d15-abc3-cc284903366f" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-3e314eaf-f8ac-4d15-abc3-cc284903366f" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206fab4-4574-462e-8b16-94be4744f9ba]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:29 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f Sep 28 18:25:29 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:30 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f" returned: 0 in 0.426s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-7be23518-2050-416a-860e-eddf94a00942-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:30 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f Sep 28 18:25:30 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Lock "cinder-7be23518-2050-416a-860e-eddf94a00942-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-1a764842-e8d8-40dd-8d48-b2c827dc0c17" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-1a764842-e8d8-40dd-8d48-b2c827dc0c17" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-7be23518-2050-416a-860e-eddf94a00942" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-7be23518-2050-416a-860e-eddf94a00942" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Deleting offline snapshot 7be23518-2050-416a-860e-eddf94a00942 of volume 1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] snapshot_file for this snap is: volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89989c-954f-4863-a828-e250cadb39e5]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 Sep 28 18:25:30 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:30 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (2227304f-0dfd-4ba6-9c25-18a0c3556e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1ec277-8ff7-49b6-b40b-4537270ae258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3e314eaf-f8ac-4d15-abc3-cc284903366f" returned: 0 in 0.440s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1ec277-8ff7-49b6-b40b-4537270ae258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544012382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f76e93f-678c-4b94-8d69-3482b19b1beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:30Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdc2c6d-2ead-48d1-9112-9fbaa686291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdc2c6d-2ead-48d1-9112-9fbaa686291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b7ed13-acef-45dc-9796-79b33b044894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b7ed13-acef-45dc-9796-79b33b044894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f76e93f-678c-4b94-8d69-3482b19b1beb', 'volume_name': 'volume-6f76e93f-678c-4b94-8d69-3482b19b1beb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928942e8-d816-453e-b977-8015cabab954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928942e8-d816-453e-b977-8015cabab954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258eb79c-9b1b-4ca4-a8c0-4c5cad7fed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:30 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Volume 6f76e93f-678c-4b94-8d69-3482b19b1beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f76e93f-678c-4b94-8d69-3482b19b1beb', 'volume_size': 1} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544012382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f76e93f-678c-4b94-8d69-3482b19b1beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:30Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Creating volume 6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:30 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-quobyte-3e314eaf-f8ac-4d15-abc3-cc284903366f" released by "delete_volume" :: held 1.014s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:30 devstack sudo[109136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb 1073741824 Sep 28 18:25:30 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Created reservations ['c449f5f3-24ac-45b2-82f6-807b76bcb256', '4cd54837-6e0f-4c1d-b9ab-867bc91c2b90', '7037ef21-4873-404c-9c45-eeebdcf88495', 'b84107dd-433d-4b78-8ba5-48aa9b745e66'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:30 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942" returned: 0 in 0.533s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73001cf-148d-410f-aae3-a0b664ad4379]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:30 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:30 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:30 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:30 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 Sep 28 18:25:30 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:31 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb 1073741824" returned: 0 in 0.601s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:31 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb Sep 28 18:25:31 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:31 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.376s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:31 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Deleted volume successfully. Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-6b1ef92e-33d2-4243-abf0-9a766bfe27b8 tempest-SnapshotDependencyTests-964879589 None] Lock "cinder-3e314eaf-f8ac-4d15-abc3-cc284903366f-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:31 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:31 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 Sep 28 18:25:31 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:31 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb" returned: 0 in 0.330s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258eb79c-9b1b-4ca4-a8c0-4c5cad7fed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f76e93f-678c-4b94-8d69-3482b19b1beb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c86ab0-d303-4902-b9fe-5848be6fd52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:31 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Volume volume-6f76e93f-678c-4b94-8d69-3482b19b1beb (6f76e93f-678c-4b94-8d69-3482b19b1beb): created successfully Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c86ab0-d303-4902-b9fe-5848be6fd52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (2227304f-0dfd-4ba6-9c25-18a0c3556e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:31 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9beded86-1db4-4b0d-8648-5d137188967f tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:25:31 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942" returned: 0 in 0.439s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:31 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942 Sep 28 18:25:31 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:32 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17.7be23518-2050-416a-860e-eddf94a00942" returned: 0 in 0.319s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-7be23518-2050-416a-860e-eddf94a00942" released by "_delete_snapshot" :: held 1.958s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-1a764842-e8d8-40dd-8d48-b2c827dc0c17" released by "delete_snapshot" :: held 1.998s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=153,cinder:DELETE=13,cinder:SELECT=123,cinder:INSERT=44 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Created reservations ['aa7ad1a1-d38a-4bdc-a324-fe18be2c40d9', 'be5d3911-515c-4668-9550-610698d05cff', '5569a5ed-a3ef-4fcd-b3be-02c4de9f20ec', '1fd9420c-b5dc-4715-b26f-f332ca1cad54'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:32 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Delete snapshot completed successfully. Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-eda96e23-9153-466c-b993-dab937baab6e tempest-ProjectReaderTests-17970903 None] Lock "cinder-7be23518-2050-416a-860e-eddf94a00942-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Creating offline snapshot f9d122ea-279b-4e79-8a1d-ab455ad70e3d of volume 6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188648b-7a38-448d-a6a8-9e1703a7c626]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:32 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb Sep 28 18:25:32 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:33 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb" returned: 0 in 0.436s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d 1G Sep 28 18:25:33 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-1a764842-e8d8-40dd-8d48-b2c827dc0c17-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Lock "cinder-1a764842-e8d8-40dd-8d48-b2c827dc0c17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-1a764842-e8d8-40dd-8d48-b2c827dc0c17" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-1a764842-e8d8-40dd-8d48-b2c827dc0c17" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c4ef39-5a51-47f8-9eba-e238b39014f7]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 Sep 28 18:25:33 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:33 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d 1G" returned: 0 in 0.591s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f76e93f-678c-4b94-8d69-3482b19b1beb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:33 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f76e93f-678c-4b94-8d69-3482b19b1beb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d Sep 28 18:25:33 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17" returned: 0 in 0.492s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17 Sep 28 18:25:34 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f76e93f-678c-4b94-8d69-3482b19b1beb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d" returned: 0 in 0.326s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d is being set with open permissions: ugo+rw Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d Sep 28 18:25:34 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-1a764842-e8d8-40dd-8d48-b2c827dc0c17" returned: 0 in 0.270s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-1a764842-e8d8-40dd-8d48-b2c827dc0c17" released by "delete_volume" :: held 0.864s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Created reservations ['032b2855-33c8-4d23-b0f9-2fafb4193361', '5fd7911c-cfdc-4a12-bb48-fe1d4622bdc0', 'c62fb05c-0d73-4b6a-861f-37119bb93a06', '9f8e5c2b-0ea0-4fd0-95e0-a7ea6773f717'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:34 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d" returned: 0 in 0.317s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info Sep 28 18:25:34 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:34 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.420s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:34 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Deleted volume successfully. Sep 28 18:25:34 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info" returned: 0 in 0.359s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:34 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info is being set with open permissions: ugo+rw Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3764164b-6444-4e64-9e18-d7a404f91607 tempest-ProjectReaderTests-17970903 None] Lock "cinder-1a764842-e8d8-40dd-8d48-b2c827dc0c17-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:35 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info Sep 28 18:25:35 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (601fd98a-8b7e-4e44-b225-d489a7c88a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f6f1e6-eb45-4675-a313-f7391b89d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f6f1e6-eb45-4675-a313-f7391b89d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084678152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e92afb-5f70-4562-9b2d-31d00e42c7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:35Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928d7df9-e59c-4835-bb07-f8a449e0bfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928d7df9-e59c-4835-bb07-f8a449e0bfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec3d492-e732-40a2-90a6-4df1b5968e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec3d492-e732-40a2-90a6-4df1b5968e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e92afb-5f70-4562-9b2d-31d00e42c7ad', 'volume_name': 'volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:35 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2163b4c-7f7b-4afe-bd81-fab78ad284f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2163b4c-7f7b-4afe-bd81-fab78ad284f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a2b338-ec72-4cec-af8a-2104a1da2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:35 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Volume 69e92afb-5f70-4562-9b2d-31d00e42c7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad', 'volume_size': 1} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.info" returned: 0 in 0.392s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084678152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e92afb-5f70-4562-9b2d-31d00e42c7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:35Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Creating volume 69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:35 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad 1073741824 Sep 28 18:25:35 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:35 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ba225e7a-bf2d-41ad-845e-db2c1ef800d3 tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:25:35 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad 1073741824" returned: 0 in 0.516s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:35 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad Sep 28 18:25:35 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-f9d122ea-279b-4e79-8a1d-ab455ad70e3d-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Lock "cinder-f9d122ea-279b-4e79-8a1d-ab455ad70e3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-6f76e93f-678c-4b94-8d69-3482b19b1beb" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-6f76e93f-678c-4b94-8d69-3482b19b1beb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-f9d122ea-279b-4e79-8a1d-ab455ad70e3d" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-f9d122ea-279b-4e79-8a1d-ab455ad70e3d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot f9d122ea-279b-4e79-8a1d-ab455ad70e3d of volume 6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[79914e64-2b03-4e5c-aba5-c59b2d709989]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d Sep 28 18:25:36 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:36 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad" returned: 0 in 0.462s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a2b338-ec72-4cec-af8a-2104a1da2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d8693e-7bff-4a16-bc1a-1a0b7cb9b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:36 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Volume volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad (69e92afb-5f70-4562-9b2d-31d00e42c7ad): created successfully Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d8693e-7bff-4a16-bc1a-1a0b7cb9b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (601fd98a-8b7e-4e44-b225-d489a7c88a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ddc5c55c-30b8-4db6-9d22-fb2a6c375430 tempest-ProjectReaderTests-17970903 None] Created volume successfully. Sep 28 18:25:36 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d" returned: 0 in 0.444s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f76e93f-678c-4b94-8d69-3482b19b1beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[af171d79-99de-41aa-b717-692e2d325602]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:36 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb Sep 28 18:25:36 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb" returned: 0 in 0.463s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d Sep 28 18:25:37 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d" returned: 0 in 0.571s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d Sep 28 18:25:37 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Creating offline snapshot b225ad98-d065-4f66-8b05-42cabe58f41e of volume 69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42a91e7-37f3-47b4-bbbb-37566baba72c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:37 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad Sep 28 18:25:37 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:38 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb.f9d122ea-279b-4e79-8a1d-ab455ad70e3d" returned: 0 in 0.315s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-f9d122ea-279b-4e79-8a1d-ab455ad70e3d" released by "_delete_snapshot" :: held 2.015s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-6f76e93f-678c-4b94-8d69-3482b19b1beb" released by "delete_snapshot" :: held 2.047s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Created reservations ['2c7c3c63-68e1-4997-8a26-60a91ab3cfa5', '90e945a9-8373-41e3-92af-39e36825e2aa', 'be538a83-f92b-442b-9370-df8182893ccf', 'e6fa756d-fc8a-4a88-91db-d0cc75c23dc3'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:38 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-603d0482-dbfc-42f9-b36f-0cfe41cadd67 tempest-ProjectMemberTests-819848877 None] Lock "cinder-f9d122ea-279b-4e79-8a1d-ab455ad70e3d-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:38 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad" returned: 0 in 0.460s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:38 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e 1G Sep 28 18:25:38 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:38 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e 1G" returned: 0 in 0.510s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:38 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:38 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e Sep 28 18:25:38 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e" returned: 0 in 0.311s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e is being set with open permissions: ugo+rw Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:39 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e Sep 28 18:25:39 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-6f76e93f-678c-4b94-8d69-3482b19b1beb-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Lock "cinder-6f76e93f-678c-4b94-8d69-3482b19b1beb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-6f76e93f-678c-4b94-8d69-3482b19b1beb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-6f76e93f-678c-4b94-8d69-3482b19b1beb" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c5bd78-060c-4a58-9e85-21f1512bc43f]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:39 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e" returned: 0 in 0.357s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:39 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info Sep 28 18:25:39 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb Sep 28 18:25:39 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info" returned: 0 in 0.343s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info is being set with open permissions: ugo+rw Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:39 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info Sep 28 18:25:39 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:39 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb" returned: 0 in 0.500s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:39 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:40 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb Sep 28 18:25:40 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:40 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.info" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-8545dc6b-9c40-4f3a-9ffd-7ebfad0211a0 tempest-ProjectReaderTests-17970903 None] Create snapshot completed successfully Sep 28 18:25:40 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-6f76e93f-678c-4b94-8d69-3482b19b1beb" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-6f76e93f-678c-4b94-8d69-3482b19b1beb" released by "delete_volume" :: held 0.882s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Created reservations ['ef107c63-a9b2-4615-b4ad-b8f920bc35ec', 'e0c536ff-c594-43b4-8fc5-114dd3ddf6b6', '5b8c352b-0da2-4d34-a058-73d77ac00327', '4ece9efb-f618-4127-9d94-d0d34dad00cd'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:40 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:40 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:40 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.329s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:40 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:25:40 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2b513841-2375-4108-90cb-6a1595fdf7e2 tempest-ProjectMemberTests-819848877 None] Lock "cinder-6f76e93f-678c-4b94-8d69-3482b19b1beb-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-b225ad98-d065-4f66-8b05-42cabe58f41e-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Lock "cinder-b225ad98-d065-4f66-8b05-42cabe58f41e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-69e92afb-5f70-4562-9b2d-31d00e42c7ad" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-69e92afb-5f70-4562-9b2d-31d00e42c7ad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-b225ad98-d065-4f66-8b05-42cabe58f41e" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-b225ad98-d065-4f66-8b05-42cabe58f41e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Deleting offline snapshot b225ad98-d065-4f66-8b05-42cabe58f41e of volume 69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] snapshot_file for this snap is: volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1cbf90-bb06-4eed-86a2-63a533038b8e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (b78e138f-7177-4851-b912-8a514f391675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f788ad-7e1d-4d11-84ca-4314d755e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f788ad-7e1d-4d11-84ca-4314d755e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306540719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0945db-23d5-482f-807a-35c304780c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:41Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558ff319-5e64-453f-8e2d-b3ae33c8f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558ff319-5e64-453f-8e2d-b3ae33c8f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b452f409-4042-4fd0-b717-a5f3af5eddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b452f409-4042-4fd0-b717-a5f3af5eddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0945db-23d5-482f-807a-35c304780c1c', 'volume_name': 'volume-bb0945db-23d5-482f-807a-35c304780c1c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6a2b07-bab0-41c1-8d69-d17c34adf904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:41 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e Sep 28 18:25:41 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6a2b07-bab0-41c1-8d69-d17c34adf904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2999be47-2b76-4227-907b-42354da58b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:41 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Volume bb0945db-23d5-482f-807a-35c304780c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0945db-23d5-482f-807a-35c304780c1c', 'volume_size': 1} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306540719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0945db-23d5-482f-807a-35c304780c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:41Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Creating volume bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:41 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:41 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c 1073741824 Sep 28 18:25:41 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:41 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e" returned: 0 in 0.407s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83a0dc6-6773-4ac1-8f22-11770252a3f2]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:41 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad Sep 28 18:25:41 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:41 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c 1073741824" returned: 0 in 0.631s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:41 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:41 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c Sep 28 18:25:41 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad" returned: 0 in 0.521s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e Sep 28 18:25:42 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c" returned: 0 in 0.356s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2999be47-2b76-4227-907b-42354da58b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0945db-23d5-482f-807a-35c304780c1c', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100b3ffe-509d-468b-86d4-5135c7051a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:42 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Volume volume-bb0945db-23d5-482f-807a-35c304780c1c (bb0945db-23d5-482f-807a-35c304780c1c): created successfully Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100b3ffe-509d-468b-86d4-5135c7051a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (b78e138f-7177-4851-b912-8a514f391675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:42 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b9df8188-b914-4887-b4aa-e903ddc757c6 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:25:42 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e" returned: 0 in 0.467s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e Sep 28 18:25:42 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad.b225ad98-d065-4f66-8b05-42cabe58f41e" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-b225ad98-d065-4f66-8b05-42cabe58f41e" released by "_delete_snapshot" :: held 1.814s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-69e92afb-5f70-4562-9b2d-31d00e42c7ad" released by "delete_snapshot" :: held 1.841s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:42 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Created reservations ['366b0bd1-7699-421c-8383-1d20e514bee8', 'baa8cfda-b3b4-4421-981d-da202d2093cb', 'aa412cfe-6870-4d16-8e4d-c04c47b87fa6', 'fd89b012-763d-456e-a64a-bcfe8d044737'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:43 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Delete snapshot completed successfully. Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-bf3ae46f-0ab5-45ae-8375-df21fe75aed5 tempest-ProjectReaderTests-17970903 None] Lock "cinder-b225ad98-d065-4f66-8b05-42cabe58f41e-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-69e92afb-5f70-4562-9b2d-31d00e42c7ad-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Lock "cinder-69e92afb-5f70-4562-9b2d-31d00e42c7ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-69e92afb-5f70-4562-9b2d-31d00e42c7ad" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-69e92afb-5f70-4562-9b2d-31d00e42c7ad" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb223c0-cfd5-4bdf-b310-b7724d82ac3e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:43 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad Sep 28 18:25:43 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Creating offline snapshot 19662c3d-abdf-42e7-a9b3-2984cc7e9695 of volume bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[6764adeb-96fd-408d-b53a-e4a9c7be1ec6]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:43 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c Sep 28 18:25:43 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:43 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad" returned: 0 in 0.486s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:43 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:43 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad Sep 28 18:25:43 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:44 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c" returned: 0 in 0.495s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:44 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 1G Sep 28 18:25:44 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:44 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-69e92afb-5f70-4562-9b2d-31d00e42c7ad" returned: 0 in 0.291s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-69e92afb-5f70-4562-9b2d-31d00e42c7ad" released by "delete_volume" :: held 0.881s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Created reservations ['6eaef7d7-63c7-40de-9e71-10f90f2a417c', '595a8a03-acf8-47d9-8321-666a873f57c6', '3fc69812-22c8-4544-83ef-fe517943c7ad', '116d79c5-176d-410e-b4ef-86b4ab54241d'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:44 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:44 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:44 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.374s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:44 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Deleted volume successfully. Sep 28 18:25:44 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 1G" returned: 0 in 0.653s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0945db-23d5-482f-807a-35c304780c1c -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:44 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2c7c9487-ff07-4406-b0df-7341109a4fec tempest-ProjectReaderTests-17970903 None] Lock "cinder-69e92afb-5f70-4562-9b2d-31d00e42c7ad-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:44 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0945db-23d5-482f-807a-35c304780c1c -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 Sep 28 18:25:44 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (5fe95ce4-858b-4d04-9327-fbc22dd2e6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffef014-5070-43f2-a888-56f71ab30260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb0945db-23d5-482f-807a-35c304780c1c -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695" returned: 0 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 is being set with open permissions: ugo+rw Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:45 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 Sep 28 18:25:45 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffef014-5070-43f2-a888-56f71ab30260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593797300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500d8c27-978c-4ddc-b700-d90bca21e9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:45Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c6ccfd-c7fc-497c-a4cc-5caee0701087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c6ccfd-c7fc-497c-a4cc-5caee0701087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb69f41-c9ce-49c2-8dcc-87f2118ef953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb69f41-c9ce-49c2-8dcc-87f2118ef953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500d8c27-978c-4ddc-b700-d90bca21e9b1', 'volume_name': 'volume-500d8c27-978c-4ddc-b700-d90bca21e9b1', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab594b6-892c-4a72-ade2-b9aeb5382f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab594b6-892c-4a72-ade2-b9aeb5382f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c4a073-c22f-4507-af93-7c98ee947e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:45 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Volume 500d8c27-978c-4ddc-b700-d90bca21e9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500d8c27-978c-4ddc-b700-d90bca21e9b1', 'volume_size': 1} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:45 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695" returned: 0 in 0.267s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:45 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info Sep 28 18:25:45 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:45 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info" returned: 0 in 0.296s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:45 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info is being set with open permissions: ugo+rw Sep 28 18:25:45 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:45 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info Sep 28 18:25:45 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:46 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.info" returned: 0 in 0.275s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593797300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=500d8c27-978c-4ddc-b700-d90bca21e9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd036318d342daaa1876a01fe25b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:45Z,use_quota=True,user_id='b786203256cf4a64a35910638b25f2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Creating volume 500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:46 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:46 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 1073741824 Sep 28 18:25:46 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ee98b63e-c0b8-4637-bd16-6c5bba7d8fad tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:25:46 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 1073741824" returned: 0 in 0.441s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:46 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 Sep 28 18:25:46 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-19662c3d-abdf-42e7-a9b3-2984cc7e9695-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Lock "cinder-19662c3d-abdf-42e7-a9b3-2984cc7e9695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-bb0945db-23d5-482f-807a-35c304780c1c" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-bb0945db-23d5-482f-807a-35c304780c1c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-19662c3d-abdf-42e7-a9b3-2984cc7e9695" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-19662c3d-abdf-42e7-a9b3-2984cc7e9695" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot 19662c3d-abdf-42e7-a9b3-2984cc7e9695 of volume bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:46 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1" returned: 0 in 0.304s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8c842-8be8-4ea6-a177-ce9ca5f4d2cd]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c4a073-c22f-4507-af93-7c98ee947e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500d8c27-978c-4ddc-b700-d90bca21e9b1', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9f467a-487c-4d73-a2a6-e0dd825888a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:46 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Volume volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 (500d8c27-978c-4ddc-b700-d90bca21e9b1): created successfully Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9f467a-487c-4d73-a2a6-e0dd825888a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:46 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Flow 'volume_create_manager' (5fe95ce4-858b-4d04-9327-fbc22dd2e6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:46 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-7f318c06-2107-45a4-a2e9-f5e350de6506 tempest-ProjectReaderTests-17970903 None] Created volume successfully. Sep 28 18:25:47 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 Sep 28 18:25:47 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:47 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695" returned: 0 in 0.438s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb0945db-23d5-482f-807a-35c304780c1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e373f0f4-a918-4be6-be8e-71f917bbf852]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Creating offline snapshot 07a5d6b7-e7b7-417d-81c5-469943314b66 of volume 500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232687a-5033-42d9-ad90-4f1f61207f36]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c Sep 28 18:25:47 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:47 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 Sep 28 18:25:47 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:47 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c" returned: 0 in 0.401s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 Sep 28 18:25:47 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:47 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1" returned: 0 in 0.454s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:47 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:47 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 1G Sep 28 18:25:47 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695" returned: 0 in 0.378s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695 Sep 28 18:25:48 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 1G" returned: 0 in 0.427s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 Sep 28 18:25:48 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c.19662c3d-abdf-42e7-a9b3-2984cc7e9695" returned: 0 in 0.264s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-19662c3d-abdf-42e7-a9b3-2984cc7e9695" released by "_delete_snapshot" :: held 1.618s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-bb0945db-23d5-482f-807a-35c304780c1c" released by "delete_snapshot" :: held 1.644s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Created reservations ['31181902-74d3-4ea0-9d8c-57077ede690b', '90d20fd3-c421-480b-a6fc-aed9caf0c61a', 'c10b6f75-55e6-40f5-b5fb-4852e12bab00', '430c6c98-059c-48b3-998a-cce9e448a660'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:48 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-9713f13e-15cb-4c1b-af53-342ce7a2f2ca tempest-ProjectMemberTests-819848877 None] Lock "cinder-19662c3d-abdf-42e7-a9b3-2984cc7e9695-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:48 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66" returned: 0 in 0.336s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 is being set with open permissions: ugo+rw Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 Sep 28 18:25:48 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:48 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66" returned: 0 in 0.263s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-bb0945db-23d5-482f-807a-35c304780c1c-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:48 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Lock "cinder-bb0945db-23d5-482f-807a-35c304780c1c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:48 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info Sep 28 18:25:48 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-bb0945db-23d5-482f-807a-35c304780c1c" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-bb0945db-23d5-482f-807a-35c304780c1c" acquired by "delete_volume" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89efd8-062c-45ad-a088-b79bbb791846]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c Sep 28 18:25:49 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info is being set with open permissions: ugo+rw Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info Sep 28 18:25:49 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c" returned: 0 in 0.422s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.info" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c Sep 28 18:25:49 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:49 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ad732500-eeea-43a0-aace-1d0d5777de90 tempest-ProjectReaderTests-17970903 None] Create snapshot completed successfully Sep 28 18:25:49 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-bb0945db-23d5-482f-807a-35c304780c1c" returned: 0 in 0.265s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-bb0945db-23d5-482f-807a-35c304780c1c" released by "delete_volume" :: held 0.760s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Created reservations ['aead8ff1-25ab-467d-a74c-f931640df035', '3d48b3fd-d6ce-4810-a0ef-74795e9e7c66', 'e1753c8a-f40b-4f71-86d3-85d0a9899596', '0738d572-7aa4-4d77-ae1d-d594514d9f75'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:49 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:49 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:49 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:50 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.264s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:50 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-65377207-c827-438c-8dce-8c691e10ccd5 tempest-ProjectMemberTests-819848877 None] Lock "cinder-bb0945db-23d5-482f-807a-35c304780c1c-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-07a5d6b7-e7b7-417d-81c5-469943314b66-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Lock "cinder-07a5d6b7-e7b7-417d-81c5-469943314b66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-500d8c27-978c-4ddc-b700-d90bca21e9b1" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-500d8c27-978c-4ddc-b700-d90bca21e9b1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-07a5d6b7-e7b7-417d-81c5-469943314b66" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-07a5d6b7-e7b7-417d-81c5-469943314b66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Deleting offline snapshot 07a5d6b7-e7b7-417d-81c5-469943314b66 of volume 500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] snapshot_file for this snap is: volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (dba4201c-4765-43f6-b54b-1adc0971f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bef7be-d53f-47a9-aea6-e12d04a0177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e57c692-0631-4a31-a9bd-eb4d9125e819]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bef7be-d53f-47a9-aea6-e12d04a0177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633407643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b65d2af-4640-4d61-bc90-f7ea5786c8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:51Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef7a6e3-d78a-40f4-8b9e-7b2845a6393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef7a6e3-d78a-40f4-8b9e-7b2845a6393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b383b-4156-469f-a6d9-ba9089849475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b383b-4156-469f-a6d9-ba9089849475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b65d2af-4640-4d61-bc90-f7ea5786c8c9', 'volume_name': 'volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebac5dad-80bf-4699-ad65-d2096723108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebac5dad-80bf-4699-ad65-d2096723108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80b8f2b-e88b-44cf-b5c5-b4e475c26fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:50 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Volume 9b65d2af-4640-4d61-bc90-f7ea5786c8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9', 'volume_size': 1} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633407643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b65d2af-4640-4d61-bc90-f7ea5786c8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:25:51Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Creating volume 9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:25:50 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:25:50 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:50 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 1073741824 Sep 28 18:25:50 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:50 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 Sep 28 18:25:50 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66" returned: 0 in 0.403s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-500d8c27-978c-4ddc-b700-d90bca21e9b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[206921fd-ef69-4c96-b01f-f0a211176f1b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 Sep 28 18:25:51 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 1073741824" returned: 0 in 0.491s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 Sep 28 18:25:51 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1" returned: 0 in 0.464s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" returned: 0 in 0.291s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:51 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 Sep 28 18:25:51 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80b8f2b-e88b-44cf-b5c5-b4e475c26fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75854bc9-07b5-4968-afac-d9267604ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:25:51 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Volume volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 (9b65d2af-4640-4d61-bc90-f7ea5786c8c9): created successfully Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75854bc9-07b5-4968-afac-d9267604ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (dba4201c-4765-43f6-b54b-1adc0971f34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:25:51 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-528785bb-421b-4f71-b256-c8405f1936ac tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:25:51 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:51 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:51 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66 Sep 28 18:25:51 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:52 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1.07a5d6b7-e7b7-417d-81c5-469943314b66" returned: 0 in 0.256s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-07a5d6b7-e7b7-417d-81c5-469943314b66" released by "_delete_snapshot" :: held 1.628s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-500d8c27-978c-4ddc-b700-d90bca21e9b1" released by "delete_snapshot" :: held 1.651s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Created reservations ['b5740228-bdf5-49f1-b41b-2e63f75f54b6', '522b04c5-90a1-482b-8e45-1c2dd3f2c5fb', '3ad22592-ca39-450e-9b38-65f386d2d60f', '2761901c-fc9e-4905-bc4b-e9113a48a602'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:52 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Delete snapshot completed successfully. Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f6bfd34f-501e-4726-b74c-8bf65877a0fe tempest-ProjectReaderTests-17970903 None] Lock "cinder-07a5d6b7-e7b7-417d-81c5-469943314b66-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-500d8c27-978c-4ddc-b700-d90bca21e9b1-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Lock "cinder-500d8c27-978c-4ddc-b700-d90bca21e9b1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Acquiring lock "cinder-quobyte-500d8c27-978c-4ddc-b700-d90bca21e9b1" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-500d8c27-978c-4ddc-b700-d90bca21e9b1" acquired by "delete_volume" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b9f035-1845-4188-b917-beae85b9446b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:52 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Creating offline snapshot a584f87e-7396-4071-a27e-72c502aca7b4 of volume 9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94221be-1194-4c6b-81ee-35c926dfa880]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 Sep 28 18:25:53 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 Sep 28 18:25:53 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1" returned: 0 in 0.429s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1 Sep 28 18:25:53 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" returned: 0 in 0.404s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 1G Sep 28 18:25:53 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:53 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-500d8c27-978c-4ddc-b700-d90bca21e9b1" returned: 0 in 0.278s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Lock "cinder-quobyte-500d8c27-978c-4ddc-b700-d90bca21e9b1" released by "delete_volume" :: held 0.803s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Created reservations ['e109e8e9-a37b-427a-ac88-014544662b64', 'c1082f4a-93e1-4bce-a70d-5a2f9bd2a654', '5b77877e-e5de-4ff6-8659-3eeaec35abfb', 'e774aaf1-b509-4c84-a14e-c223cf43ee81'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:53 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:53 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:53 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 1G" returned: 0 in 0.550s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 Sep 28 18:25:54 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.303s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:54 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Deleted volume successfully. Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ba77b648-a5e1-47a7-ada9-7aeba0c5684a tempest-ProjectReaderTests-17970903 None] Lock "cinder-500d8c27-978c-4ddc-b700-d90bca21e9b1-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:54 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4" returned: 0 in 0.373s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 is being set with open permissions: ugo+rw Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 Sep 28 18:25:54 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:54 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4" returned: 0 in 0.286s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:54 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:54 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info Sep 28 18:25:54 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:55 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info" returned: 0 in 0.290s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:55 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info is being set with open permissions: ugo+rw Sep 28 18:25:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:55 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info Sep 28 18:25:55 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:55 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.info" returned: 0 in 0.330s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:55 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:55 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-efe41995-b91b-4784-99e0-cc5e6d31a036 tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-a584f87e-7396-4071-a27e-72c502aca7b4-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-a584f87e-7396-4071-a27e-72c502aca7b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-a584f87e-7396-4071-a27e-72c502aca7b4" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-a584f87e-7396-4071-a27e-72c502aca7b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot a584f87e-7396-4071-a27e-72c502aca7b4 of volume 9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c3bfa7-69d8-47dc-9a5c-f61b0c5a65a4]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:56 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 Sep 28 18:25:56 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:56 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb12fe-bf61-4bf1-91e8-9ef56ab654ae]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:56 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:56 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 Sep 28 18:25:56 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" returned: 0 in 0.400s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 Sep 28 18:25:57 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4" returned: 0 in 0.432s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:57 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4 Sep 28 18:25:57 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:57 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:57 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9.a584f87e-7396-4071-a27e-72c502aca7b4" returned: 0 in 0.293s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-a584f87e-7396-4071-a27e-72c502aca7b4" released by "_delete_snapshot" :: held 1.652s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" released by "delete_snapshot" :: held 1.676s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Created reservations ['d91ef5fc-0847-4928-beab-0c19f2c2308f', 'cdc08c1d-1657-4390-af42-1604b81ad208', '64e76e37-e47f-4422-819b-8d6a622247f0', '8785c02b-085e-469c-872d-0d617025d1c4'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:58 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-625082f5-021a-4373-ad72-96896d80eee0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-a584f87e-7396-4071-a27e-72c502aca7b4-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-9b65d2af-4640-4d61-bc90-f7ea5786c8c9-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Lock "cinder-9b65d2af-4640-4d61-bc90-f7ea5786c8c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" acquired by "delete_volume" :: waited 0.024s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18590b3-d8f8-4cfd-b576-9f9417994932]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:58 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:58 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 Sep 28 18:25:58 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:59 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" returned: 0 in 0.426s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:59 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9 Sep 28 18:25:59 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:59 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" returned: 0 in 0.335s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-9b65d2af-4640-4d61-bc90-f7ea5786c8c9" released by "delete_volume" :: held 0.840s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Created reservations ['944fd372-a246-4c4e-8612-de65b4ff0c04', 'a2b5b78a-8d34-4108-8402-f966ac3fb572', 'd10d8968-e077-4ca8-abee-7cb25d7c78aa', '32b7313a-ed49-4687-bd95-62318fafd2ec'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:59 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:25:59 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:59 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.346s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:59 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:25:59 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-5e029247-8671-45e7-9d25-e3ec35e4831c tempest-ProjectMemberTests-819848877 None] Lock "cinder-9b65d2af-4640-4d61-bc90-f7ea5786c8c9-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (91e3fb15-73be-4178-8855-32c06278ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f2d0f-2b9b-493b-a67c-be893cdf82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624f2d0f-2b9b-493b-a67c-be893cdf82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850642668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbb03e1-a310-4455-9756-aafbc45b287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:00Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a97857-6bfe-452b-beda-42c5b7d12013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a97857-6bfe-452b-beda-42c5b7d12013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf813ad-9ac3-4c0f-b37f-71d52d28300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf813ad-9ac3-4c0f-b37f-71d52d28300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbb03e1-a310-4455-9756-aafbc45b287d', 'volume_name': 'volume-3dbb03e1-a310-4455-9756-aafbc45b287d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56136b1-4485-45fc-aa83-65b9788c3ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56136b1-4485-45fc-aa83-65b9788c3ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f498efe-345a-4df1-b188-bf994327c102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Volume 3dbb03e1-a310-4455-9756-aafbc45b287d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbb03e1-a310-4455-9756-aafbc45b287d', 'volume_size': 1} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850642668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbb03e1-a310-4455-9756-aafbc45b287d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:00Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Creating volume 3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:00 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d 1073741824 Sep 28 18:26:00 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:00 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d 1073741824" returned: 0 in 0.512s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:00 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:00 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d Sep 28 18:26:00 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d" returned: 0 in 0.310s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f498efe-345a-4df1-b188-bf994327c102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbb03e1-a310-4455-9756-aafbc45b287d', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8bfb47-43a1-4128-996a-908ac4e0700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:01 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Volume volume-3dbb03e1-a310-4455-9756-aafbc45b287d (3dbb03e1-a310-4455-9756-aafbc45b287d): created successfully Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8bfb47-43a1-4128-996a-908ac4e0700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:01 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (91e3fb15-73be-4178-8855-32c06278ff94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:01 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-96a2fc54-d4c5-4148-879c-68722603a451 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Creating offline snapshot 0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e of volume 3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5ee2a-5964-4d52-8562-be4ca64bb1c3]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d Sep 28 18:26:02 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d" returned: 0 in 0.428s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e 1G Sep 28 18:26:03 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e 1G" returned: 0 in 0.567s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbb03e1-a310-4455-9756-aafbc45b287d -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbb03e1-a310-4455-9756-aafbc45b287d -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e Sep 28 18:26:03 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbb03e1-a310-4455-9756-aafbc45b287d -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" returned: 0 in 0.354s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e is being set with open permissions: ugo+rw Sep 28 18:26:03 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e Sep 28 18:26:03 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" returned: 0 in 0.286s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info Sep 28 18:26:04 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info" returned: 0 in 0.347s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info is being set with open permissions: ugo+rw Sep 28 18:26:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info Sep 28 18:26:04 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.info" returned: 0 in 0.256s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:04 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-b1d220c8-304f-42d4-a88a-07cd3d11a07e tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Lock "cinder-0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-3dbb03e1-a310-4455-9756-aafbc45b287d" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-3dbb03e1-a310-4455-9756-aafbc45b287d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot 0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e of volume 3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e14701e-9729-4421-80b6-47ee9ea51f3c]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:05 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e Sep 28 18:26:05 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:06 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" returned: 0 in 0.421s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:06 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dbb03e1-a310-4455-9756-aafbc45b287d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:06 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3bd9e4-0bf3-4409-8ce3-9004e65a7e6d]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:06 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d Sep 28 18:26:06 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:06 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d" returned: 0 in 0.442s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:06 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:06 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e Sep 28 18:26:06 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" returned: 0 in 0.391s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:07 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e Sep 28 18:26:07 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d.0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" returned: 0 in 0.298s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e" released by "_delete_snapshot" :: held 1.702s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-3dbb03e1-a310-4455-9756-aafbc45b287d" released by "delete_snapshot" :: held 1.727s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Created reservations ['d81248eb-6d79-4156-b8e9-9dcae0c0a4a6', '2ef63378-9bb4-4faa-a8f5-a6fb633c75b5', 'a4b6d3a4-2f78-4f09-ad30-28cec812bc43', 'df2c06aa-e547-4073-9047-451145232a36'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:07 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-ecde4732-ffef-4dc6-9c88-1dd3f247aac8 tempest-ProjectMemberTests-819848877 None] Lock "cinder-0e19a348-d2fd-4e49-a9d5-83ab30fc1c8e-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-3dbb03e1-a310-4455-9756-aafbc45b287d-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Lock "cinder-3dbb03e1-a310-4455-9756-aafbc45b287d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-3dbb03e1-a310-4455-9756-aafbc45b287d" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:07 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-3dbb03e1-a310-4455-9756-aafbc45b287d" acquired by "delete_volume" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5bc5c2-1c67-4c84-a92a-e53f7926d906]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:08 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d Sep 28 18:26:08 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:08 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d" returned: 0 in 0.369s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:08 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d Sep 28 18:26:08 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:08 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-3dbb03e1-a310-4455-9756-aafbc45b287d" returned: 0 in 0.258s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-3dbb03e1-a310-4455-9756-aafbc45b287d" released by "delete_volume" :: held 0.697s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Created reservations ['1644be3d-30c4-4fa6-bca0-45a097995ba2', 'd1f24c54-8b9f-4aac-a754-b359244d8bc0', '3ea12847-e934-4682-8823-c441553e8aa4', 'bd1d3d83-864b-41e1-90b4-be8a6596810a'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:08 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:08 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:26:08 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:09 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.314s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:09 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-3159f813-a6fa-4c5e-a4e4-504fa4891767 tempest-ProjectMemberTests-819848877 None] Lock "cinder-3dbb03e1-a310-4455-9756-aafbc45b287d-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (f82027d0-ce00-461f-81fd-e74e888968fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9bb187-7be3-4143-b54b-d0c246767401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9bb187-7be3-4143-b54b-d0c246767401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367113977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0979b4bc-6860-43fe-b058-68498473190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:10Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9200a94-c9cc-47d8-8245-6ee4f11ef142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9200a94-c9cc-47d8-8245-6ee4f11ef142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3553d4-5da0-47fc-9a41-836047586e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3553d4-5da0-47fc-9a41-836047586e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0979b4bc-6860-43fe-b058-68498473190b', 'volume_name': 'volume-0979b4bc-6860-43fe-b058-68498473190b', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f413728-3c94-46f8-a465-c20616da79f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f413728-3c94-46f8-a465-c20616da79f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c72a46a-3af6-41e0-8817-bb632c4bef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:09 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Volume 0979b4bc-6860-43fe-b058-68498473190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0979b4bc-6860-43fe-b058-68498473190b', 'volume_size': 1} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367113977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0979b4bc-6860-43fe-b058-68498473190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:10Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Creating volume 0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:09 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:26:09 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:09 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b 1073741824 Sep 28 18:26:09 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:10 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b 1073741824" returned: 0 in 0.459s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:10 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b Sep 28 18:26:10 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:10 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c72a46a-3af6-41e0-8817-bb632c4bef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0979b4bc-6860-43fe-b058-68498473190b', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0d28a1-37a9-4549-b35c-480db6a673ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:10 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Volume volume-0979b4bc-6860-43fe-b058-68498473190b (0979b4bc-6860-43fe-b058-68498473190b): created successfully Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0d28a1-37a9-4549-b35c-480db6a673ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:10 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (f82027d0-ce00-461f-81fd-e74e888968fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:10 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-122b5949-4efa-4521-979c-3399c07a4512 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:26:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:11 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Creating offline snapshot 6f5f4725-0f79-4def-83e9-3b5e493b4ac5 of volume 0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:11 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[55071325-0fe0-4f56-adbe-5c09356971f9]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:11 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:12 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b Sep 28 18:26:12 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:12 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b" returned: 0 in 0.383s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:12 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 1G Sep 28 18:26:12 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:12 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 1G" returned: 0 in 0.475s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:12 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0979b4bc-6860-43fe-b058-68498473190b -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:12 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0979b4bc-6860-43fe-b058-68498473190b -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 Sep 28 18:26:12 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0979b4bc-6860-43fe-b058-68498473190b -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5" returned: 0 in 0.371s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 is being set with open permissions: ugo+rw Sep 28 18:26:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 Sep 28 18:26:13 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info Sep 28 18:26:13 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:13 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info" returned: 0 in 0.360s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:13 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info is being set with open permissions: ugo+rw Sep 28 18:26:13 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:13 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info Sep 28 18:26:13 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:14 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.info" returned: 0 in 0.280s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:14 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:14 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4b33fd4e-e627-4dbb-b8c4-551ad2233747 tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-6f5f4725-0f79-4def-83e9-3b5e493b4ac5-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Lock "cinder-6f5f4725-0f79-4def-83e9-3b5e493b4ac5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-0979b4bc-6860-43fe-b058-68498473190b" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-0979b4bc-6860-43fe-b058-68498473190b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-6f5f4725-0f79-4def-83e9-3b5e493b4ac5" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-6f5f4725-0f79-4def-83e9-3b5e493b4ac5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot 6f5f4725-0f79-4def-83e9-3b5e493b4ac5 of volume 0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93f507-183a-4aca-95ba-326e583db131]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:15 devstack sudo[109635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 Sep 28 18:26:15 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:15 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5" returned: 0 in 0.414s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0979b4bc-6860-43fe-b058-68498473190b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39f232-7075-4e6f-b6c0-16697b595cc1]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:15 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:15 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b Sep 28 18:26:15 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b" returned: 0 in 0.442s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 Sep 28 18:26:16 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5" returned: 0 in 0.420s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5 Sep 28 18:26:16 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b.6f5f4725-0f79-4def-83e9-3b5e493b4ac5" returned: 0 in 0.289s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-6f5f4725-0f79-4def-83e9-3b5e493b4ac5" released by "_delete_snapshot" :: held 1.696s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-0979b4bc-6860-43fe-b058-68498473190b" released by "delete_snapshot" :: held 1.722s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:16 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Created reservations ['e241f810-34c5-424c-a2d7-eb1de59555ec', '762059ee-3882-413c-88f3-1c0b7c7de060', '9a3c7038-dc44-4c39-b2f4-9ae711c08f0c', '01a4375a-6e71-4a6e-8daa-f9df2f05cd82'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:17 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-effa3941-9712-49eb-8097-d5ccf2f34f62 tempest-ProjectMemberTests-819848877 None] Lock "cinder-6f5f4725-0f79-4def-83e9-3b5e493b4ac5-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-0979b4bc-6860-43fe-b058-68498473190b-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Lock "cinder-0979b4bc-6860-43fe-b058-68498473190b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-0979b4bc-6860-43fe-b058-68498473190b" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-0979b4bc-6860-43fe-b058-68498473190b" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80eb378-52aa-427e-846f-be32f17e427b]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Flow 'volume_create_manager' (b10eb4ac-2f2b-4833-9ee5-5c569a1d0866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c309e79-b532-4c1b-ba6f-791942e77046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c309e79-b532-4c1b-ba6f-791942e77046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46837206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e030cde4-52e1-4e16-8ffc-36d0ecb1db66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadd7b28d9e44d728645ccc99401c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:17Z,use_quota=True,user_id='591a6e5818cf4436955e45c88014c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0975377f-3bdb-4670-a95e-8499aa450a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0975377f-3bdb-4670-a95e-8499aa450a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7d45da-3250-4a7c-90e3-784b4b305e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7d45da-3250-4a7c-90e3-784b4b305e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e030cde4-52e1-4e16-8ffc-36d0ecb1db66', 'volume_name': 'volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28346ece-78a5-4579-ab4f-e25229a7e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:17 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28346ece-78a5-4579-ab4f-e25229a7e8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:17 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b57d81-3799-4c23-a21c-a50374a29a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:17 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Volume e030cde4-52e1-4e16-8ffc-36d0ecb1db66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66', 'volume_size': 1} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-46837206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e030cde4-52e1-4e16-8ffc-36d0ecb1db66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadd7b28d9e44d728645ccc99401c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:17Z,use_quota=True,user_id='591a6e5818cf4436955e45c88014c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Creating volume e030cde4-52e1-4e16-8ffc-36d0ecb1db66 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:17 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 1073741824 Sep 28 18:26:17 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b" returned: 0 in 0.412s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b Sep 28 18:26:17 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 1073741824" returned: 0 in 0.509s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-0979b4bc-6860-43fe-b058-68498473190b" returned: 0 in 0.296s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 Sep 28 18:26:18 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-0979b4bc-6860-43fe-b058-68498473190b" released by "delete_volume" :: held 0.790s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Created reservations ['26c8ff56-21c7-476d-b4ef-5e43d6b5a605', '53a756ee-241b-4b32-9e1e-4edc2791c65a', '9e09b150-813d-48f7-bc78-e543bde8e4a8', '0356c8a8-843b-4980-a375-f5636a350f33'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:26:18 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b57d81-3799-4c23-a21c-a50374a29a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a18ec2c-0dc3-4ed1-9d11-a265063c250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:18 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Volume volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 (e030cde4-52e1-4e16-8ffc-36d0ecb1db66): created successfully Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a18ec2c-0dc3-4ed1-9d11-a265063c250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Flow 'volume_create_manager' (b10eb4ac-2f2b-4833-9ee5-5c569a1d0866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:18 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a1c75cf4-6ae6-42e0-99a5-651e7305f029 tempest-ProjectReaderTests-634342293 None] Created volume successfully. Sep 28 18:26:18 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:18 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:26:18 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-228a5c68-94c6-42ca-9b96-db339fd10eba tempest-ProjectMemberTests-819848877 None] Lock "cinder-0979b4bc-6860-43fe-b058-68498473190b-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (e23464fb-edd9-48b8-bb02-9fa26d408cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaeb8d9-49b0-472a-acc5-9aca82cfbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaeb8d9-49b0-472a-acc5-9aca82cfbbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173590738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11045b5f-ed10-49c8-9144-f2da5caef064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:19Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09c0362-5821-4fc1-95c5-8b583673faf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09c0362-5821-4fc1-95c5-8b583673faf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07f7b93-08cc-4311-8f0a-226061096a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07f7b93-08cc-4311-8f0a-226061096a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11045b5f-ed10-49c8-9144-f2da5caef064', 'volume_name': 'volume-11045b5f-ed10-49c8-9144-f2da5caef064', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b84e2-5f39-4184-8d9f-13b1fea02a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b84e2-5f39-4184-8d9f-13b1fea02a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc74b66-6379-4feb-8ec4-3cb0bf1051e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Volume 11045b5f-ed10-49c8-9144-f2da5caef064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11045b5f-ed10-49c8-9144-f2da5caef064', 'volume_size': 1} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173590738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11045b5f-ed10-49c8-9144-f2da5caef064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:19Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Creating volume 11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:19 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 1073741824 Sep 28 18:26:19 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 1073741824" returned: 0 in 0.455s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 Sep 28 18:26:19 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Acquiring lock "cinder-e030cde4-52e1-4e16-8ffc-36d0ecb1db66-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Lock "cinder-e030cde4-52e1-4e16-8ffc-36d0ecb1db66-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Acquiring lock "cinder-quobyte-e030cde4-52e1-4e16-8ffc-36d0ecb1db66" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Lock "cinder-quobyte-e030cde4-52e1-4e16-8ffc-36d0ecb1db66" acquired by "delete_volume" :: waited 0.015s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe78ab-110f-4612-9836-77d3d2789cce]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064" returned: 0 in 0.286s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc74b66-6379-4feb-8ec4-3cb0bf1051e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11045b5f-ed10-49c8-9144-f2da5caef064', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf0f3c3-02f5-4f19-8a2c-68987e162b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:19 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Volume volume-11045b5f-ed10-49c8-9144-f2da5caef064 (11045b5f-ed10-49c8-9144-f2da5caef064): created successfully Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf0f3c3-02f5-4f19-8a2c-68987e162b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:19 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (e23464fb-edd9-48b8-bb02-9fa26d408cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:19 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 Sep 28 18:26:20 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:20 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f3b3ab5f-5734-480f-a7cb-583089450c24 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:26:20 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:20 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66 Sep 28 18:26:20 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:20 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-e030cde4-52e1-4e16-8ffc-36d0ecb1db66" returned: 0 in 0.255s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Lock "cinder-quobyte-e030cde4-52e1-4e16-8ffc-36d0ecb1db66" released by "delete_volume" :: held 0.694s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Created reservations ['b4aa96e9-7034-4d77-ba7c-06e9ea104030', '7a83d65f-4ab5-4844-bad5-a141e37eb4fb', 'ac4beab5-ac32-49bc-8f3e-2d66c5cd810f', 'bcd901e8-c414-469b-b9b4-a5a2fca576f3'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:20 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:20 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:26:20 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:21 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.279s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:21 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Deleted volume successfully. Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-a339a296-91f7-489d-a1ea-f051debd6769 tempest-ProjectReaderTests-634342293 None] Lock "cinder-e030cde4-52e1-4e16-8ffc-36d0ecb1db66-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Flow 'volume_create_manager' (ff0e0b1d-62ef-4578-876e-ac03d98099d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4fc27d-2d3c-4d18-b8d1-8242cd7e6dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Creating offline snapshot 66b83b4d-8a66-4030-bd94-5dadfac79ec4 of volume 11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4fc27d-2d3c-4d18-b8d1-8242cd7e6dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220217537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5659ca2-dd3f-4930-ba5d-97b58fd143e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadd7b28d9e44d728645ccc99401c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:22Z,use_quota=True,user_id='591a6e5818cf4436955e45c88014c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaa7d9e-0bcd-47a0-a88f-31e24135719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caaa7d9e-0bcd-47a0-a88f-31e24135719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f685d798-ffe9-4310-833c-e972a37bde4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f685d798-ffe9-4310-833c-e972a37bde4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5659ca2-dd3f-4930-ba5d-97b58fd143e7', 'volume_name': 'volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4692f757-7670-486f-93b9-b2bba22b98ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4692f757-7670-486f-93b9-b2bba22b98ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf7a530-0df5-40f3-a56c-956f1889a062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:21 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Volume f5659ca2-dd3f-4930-ba5d-97b58fd143e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7', 'volume_size': 1} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1e9cd-8729-46f2-8b5c-c3e0b8b2cf02]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:21 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:21 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 Sep 28 18:26:21 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064" returned: 0 in 0.380s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 1G Sep 28 18:26:22 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 1G" returned: 0 in 0.457s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11045b5f-ed10-49c8-9144-f2da5caef064 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11045b5f-ed10-49c8-9144-f2da5caef064 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 Sep 28 18:26:22 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11045b5f-ed10-49c8-9144-f2da5caef064 -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 is being set with open permissions: ugo+rw Sep 28 18:26:22 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 Sep 28 18:26:22 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4" returned: 0 in 0.311s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:23 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info Sep 28 18:26:23 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info" returned: 0 in 0.299s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info is being set with open permissions: ugo+rw Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:23 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info Sep 28 18:26:23 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_service.periodic_task [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] Running periodic task VolumeManager._thread_info {{(pid=87096) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread count: 28 {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-ab5188f3-dfe7-46b2-9929-b1d2730e4ba7 None None] thread info: [<_MainThread(MainThread, started 124002814873728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87096) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:26:23 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.info" returned: 0 in 0.283s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.084s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220217537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5659ca2-dd3f-4930-ba5d-97b58fd143e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadd7b28d9e44d728645ccc99401c9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:22Z,use_quota=True,user_id='591a6e5818cf4436955e45c88014c349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Creating volume f5659ca2-dd3f-4930-ba5d-97b58fd143e7 {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:23 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:26:23 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:23 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 1073741824 Sep 28 18:26:23 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-cfb80cdf-d97f-48bf-b6b6-875dacdc8929 tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:26:24 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 1073741824" returned: 0 in 0.453s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:24 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 Sep 28 18:26:24 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:24 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7" returned: 0 in 0.269s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:SELECT=163,cinder:UPDATE=199,cinder:INSERT=53,cinder:DELETE=14 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf7a530-0df5-40f3-a56c-956f1889a062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d4d7f8-d49d-4889-b388-45e3733c0220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:24 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Volume volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 (f5659ca2-dd3f-4930-ba5d-97b58fd143e7): created successfully Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d4d7f8-d49d-4889-b388-45e3733c0220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Flow 'volume_create_manager' (ff0e0b1d-62ef-4578-876e-ac03d98099d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:24 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-e1cb394b-9a29-4872-b803-5e208a8544e9 tempest-ProjectReaderTests-634342293 None] Created volume successfully. Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-66b83b4d-8a66-4030-bd94-5dadfac79ec4-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Lock "cinder-66b83b4d-8a66-4030-bd94-5dadfac79ec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-11045b5f-ed10-49c8-9144-f2da5caef064" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-11045b5f-ed10-49c8-9144-f2da5caef064" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-66b83b4d-8a66-4030-bd94-5dadfac79ec4" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-66b83b4d-8a66-4030-bd94-5dadfac79ec4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot 66b83b4d-8a66-4030-bd94-5dadfac79ec4 of volume 11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a5dd0-c887-44c1-b938-3bb9ac48e973]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:24 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:24 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 Sep 28 18:26:24 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:25 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4" returned: 0 in 0.370s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11045b5f-ed10-49c8-9144-f2da5caef064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe546159-96dc-46d3-9921-3dc1e270f448]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:25 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 Sep 28 18:26:25 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:25 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064" returned: 0 in 0.394s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:25 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 Sep 28 18:26:25 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Acquiring lock "cinder-f5659ca2-dd3f-4930-ba5d-97b58fd143e7-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Lock "cinder-f5659ca2-dd3f-4930-ba5d-97b58fd143e7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Acquiring lock "cinder-quobyte-f5659ca2-dd3f-4930-ba5d-97b58fd143e7" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Lock "cinder-quobyte-f5659ca2-dd3f-4930-ba5d-97b58fd143e7" acquired by "delete_volume" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[53174514-336f-4f46-97e5-e068aa434709]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:25 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4" returned: 0 in 0.442s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 Sep 28 18:26:26 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4 Sep 28 18:26:26 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064.66b83b4d-8a66-4030-bd94-5dadfac79ec4" returned: 0 in 0.281s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7" returned: 0 in 0.423s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-66b83b4d-8a66-4030-bd94-5dadfac79ec4" released by "_delete_snapshot" :: held 1.612s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-11045b5f-ed10-49c8-9144-f2da5caef064" released by "delete_snapshot" :: held 1.640s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:26 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7 Sep 28 18:26:26 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Created reservations ['ee287528-40e3-46a1-a467-c15598430923', '492232a1-a18a-4f11-a8ff-5ece32825fec', '3ae805ac-97bf-4cd3-b71b-03c5eef8d504', 'bfa9865a-f32c-486e-94c8-582aef816b55'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:26 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-2af59ab9-f412-42f2-97c5-2b839019de5c tempest-ProjectMemberTests-819848877 None] Lock "cinder-66b83b4d-8a66-4030-bd94-5dadfac79ec4-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:26 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-f5659ca2-dd3f-4930-ba5d-97b58fd143e7" returned: 0 in 0.318s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Lock "cinder-quobyte-f5659ca2-dd3f-4930-ba5d-97b58fd143e7" released by "delete_volume" :: held 0.790s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Created reservations ['e7328413-4ebe-41a6-8fc4-a2dc55823479', 'b9145b18-d98b-46e6-9700-222495f45d4d', 'ffcd2acd-0222-4f2f-a45d-8a7d21e65f3a', 'dfa692f0-0645-4508-a592-b929ae9e5b83'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:26 devstack sudo[109755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:26:26 devstack sudo[109755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-11045b5f-ed10-49c8-9144-f2da5caef064-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:26 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-11045b5f-ed10-49c8-9144-f2da5caef064-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-11045b5f-ed10-49c8-9144-f2da5caef064" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-11045b5f-ed10-49c8-9144-f2da5caef064" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c76a33-4b5a-4025-81e9-471d1478847e]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:27 devstack sudo[109755]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.381s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:27 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Deleted volume successfully. Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4337889d-04f3-42fc-8a8a-619e9444c27d tempest-ProjectReaderTests-634342293 None] Lock "cinder-f5659ca2-dd3f-4930-ba5d-97b58fd143e7-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:27 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 Sep 28 18:26:27 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:27 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064" returned: 0 in 0.498s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:27 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064 Sep 28 18:26:27 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:27 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-11045b5f-ed10-49c8-9144-f2da5caef064" returned: 0 in 0.263s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-11045b5f-ed10-49c8-9144-f2da5caef064" released by "delete_volume" :: held 0.854s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:27 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Created reservations ['51340598-a33c-47ca-bb99-77a4b20d9e04', 'db750088-0d38-45d9-b150-f03c9d860b8f', 'a51d9c9c-84b8-466a-8f77-5c2c09545deb', 'be57c833-306c-4b3d-a0d5-b4f7af566fff'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:28 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:26:28 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:28 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.326s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:28 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-88a08cc0-bc46-4e72-8eb2-98cbc56440c0 tempest-ProjectMemberTests-819848877 None] Lock "cinder-11045b5f-ed10-49c8-9144-f2da5caef064-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.flows.manager.create_volume [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87096) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (98111806-c554-4f97-8fd2-b8a10ceef9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272588d5-29ab-4e33-ae0e-8f336b15e342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272588d5-29ab-4e33-ae0e-8f336b15e342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018757958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed9afa-85e9-419e-9c01-67e2468921cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:29Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1327f65-a16b-4cb8-bc64-13bb4b588855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1327f65-a16b-4cb8-bc64-13bb4b588855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c28e3d-8e1c-409f-ac7f-b84ba9940313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c28e3d-8e1c-409f-ac7f-b84ba9940313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beed9afa-85e9-419e-9c01-67e2468921cb', 'volume_name': 'volume-beed9afa-85e9-419e-9c01-67e2468921cb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888e8c14-d6cd-4223-a378-5a6b0f22b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888e8c14-d6cd-4223-a378-5a6b0f22b355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f91a84-8c01-483c-9610-aa088ff2f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:28 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Volume beed9afa-85e9-419e-9c01-67e2468921cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beed9afa-85e9-419e-9c01-67e2468921cb', 'volume_size': 1} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018757958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed9afa-85e9-419e-9c01-67e2468921cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d829499fb2e340f0aa2019253599446a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:29Z,use_quota=True,user_id='181cfea7e951467a884df0f8607160a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce462a9d-19a6-4b7f-bcca-b6ba454eb72c),volume_type_id=ce462a9d-19a6-4b7f-bcca-b6ba454eb72c)}" {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Creating volume beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Selected osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e as target Quobyte volume. {{(pid=87096) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:28 devstack cinder-volume[87096]: INFO cinder.volume.drivers.remotefs [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] casted to osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e Sep 28 18:26:28 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb 1073741824 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:28 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb 1073741824 Sep 28 18:26:28 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:29 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb 1073741824" returned: 0 in 0.514s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:29 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb Sep 28 18:26:29 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:29 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb" returned: 0 in 0.281s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'} {{(pid=87096) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f91a84-8c01-483c-9610-aa088ff2f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beed9afa-85e9-419e-9c01-67e2468921cb', 'volume_size': 1}' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585df642-a870-481b-993d-ceb432b208ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:29 devstack cinder-volume[87096]: INFO cinder.volume.flows.manager.create_volume [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Volume volume-beed9afa-85e9-419e-9c01-67e2468921cb (beed9afa-85e9-419e-9c01-67e2468921cb): created successfully Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585df642-a870-481b-993d-ceb432b208ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87096) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:29 devstack cinder-volume[87096]: DEBUG cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Flow 'volume_create_manager' (98111806-c554-4f97-8fd2-b8a10ceef9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87096) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:29 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-704ca5b6-0924-49b9-8782-c0b429b67c26 tempest-ProjectMemberTests-819848877 None] Created volume successfully. Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Creating offline snapshot 4b4cf263-9138-4440-8a5b-25c5f8e10ca7 of volume beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c7dcfc-688e-4686-96e8-8cf52606b249]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:31 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb Sep 28 18:26:31 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:31 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb" returned: 0 in 0.408s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:31 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 1G {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:31 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 1G Sep 28 18:26:31 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:32 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 1G" returned: 0 in 0.439s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beed9afa-85e9-419e-9c01-67e2468921cb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:32 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beed9afa-85e9-419e-9c01-67e2468921cb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 Sep 28 18:26:32 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:32 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beed9afa-85e9-419e-9c01-67e2468921cb -F qcow2 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7" returned: 0 in 0.328s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:32 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 is being set with open permissions: ugo+rw Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:32 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 Sep 28 18:26:32 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:32 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7" returned: 0 in 0.266s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:INSERT=49,cinder:UPDATE=181,cinder:SELECT=125,cinder:DELETE=15 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:32 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:32 devstack sudo[109796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info Sep 28 18:26:32 devstack sudo[109796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[109796]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info" returned: 0 in 0.284s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[87096]: WARNING cinder.volume.drivers.remotefs [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info is being set with open permissions: ugo+rw Sep 28 18:26:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:33 devstack sudo[109799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info Sep 28 18:26:33 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.info" returned: 0 in 0.297s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:33 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-71dca3b0-19f6-4a3f-8558-37c5262a9f89 tempest-ProjectMemberTests-819848877 None] Create snapshot completed successfully Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-4b4cf263-9138-4440-8a5b-25c5f8e10ca7-delete_snapshot" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Lock "cinder-4b4cf263-9138-4440-8a5b-25c5f8e10ca7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-beed9afa-85e9-419e-9c01-67e2468921cb" by "delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-beed9afa-85e9-419e-9c01-67e2468921cb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-4b4cf263-9138-4440-8a5b-25c5f8e10ca7" by "_delete_snapshot" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-4b4cf263-9138-4440-8a5b-25c5f8e10ca7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Deleting offline snapshot 4b4cf263-9138-4440-8a5b-25c5f8e10ca7 of volume beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] snapshot_file for this snap is: volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 {{(pid=87096) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661b008-986c-4cf0-9480-a20dc6196a32]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:34 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 Sep 28 18:26:34 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:34 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7" returned: 0 in 0.421s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.remotefs [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beed9afa-85e9-419e-9c01-67e2468921cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87096) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38d3da1-3d11-49ad-8a9d-475b09782a56]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:34 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:35 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb Sep 28 18:26:35 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:35 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb" returned: 0 in 0.404s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:35 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 Sep 28 18:26:35 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:35 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7" returned: 0 in 0.398s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:35 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:35 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7 Sep 28 18:26:35 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:36 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb.4b4cf263-9138-4440-8a5b-25c5f8e10ca7" returned: 0 in 0.295s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-4b4cf263-9138-4440-8a5b-25c5f8e10ca7" released by "_delete_snapshot" :: held 1.635s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-beed9afa-85e9-419e-9c01-67e2468921cb" released by "delete_snapshot" :: held 1.662s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Created reservations ['9fda261b-b1d4-4dd2-bf52-7fdb4968260f', 'db6e33f7-188a-4899-b597-c71c15e4b1bb', 'dd9d6d86-6e90-4fcb-8d13-8875af6e3e20', 'f4e2a05a-2d48-45ba-9802-e593250fab99'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:36 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Delete snapshot completed successfully. Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-f830281f-dc6f-414a-b679-d9eefe9553c9 tempest-ProjectMemberTests-819848877 None] Lock "cinder-4b4cf263-9138-4440-8a5b-25c5f8e10ca7-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-beed9afa-85e9-419e-9c01-67e2468921cb-delete_volume" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Lock "cinder-beed9afa-85e9-419e-9c01-67e2468921cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Acquiring lock "cinder-quobyte-beed9afa-85e9-419e-9c01-67e2468921cb" by "delete_volume" {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-beed9afa-85e9-419e-9c01-67e2468921cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87096) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8c45da-9ee4-4413-bec2-df74a0608b71]: (4, 'qcow2') {{(pid=88847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:36 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:36 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb Sep 28 18:26:36 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:37 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb" returned: 0 in 0.393s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:37 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb Sep 28 18:26:37 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:37 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75/volume-beed9afa-85e9-419e-9c01-67e2468921cb" returned: 0 in 0.260s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Lock "cinder-quobyte-beed9afa-85e9-419e-9c01-67e2468921cb" released by "delete_volume" :: held 0.720s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG cinder.quota [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Created reservations ['2bbb5d64-dee7-4e18-a635-78196f4ad32f', '04faff6c-9770-4008-9849-c2283116852d', 'f34bee5e-1a95-4b52-8024-fa94c7917999', '5a823931-dbff-402a-9e4f-7881d0c95dca'] {{(pid=87096) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e': None} {{(pid=87096) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG cinder.volume.drivers.quobyte [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d9c96273-6f6e-42be-bd33-d50415036b1e'] {{(pid=87096) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.lockutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87096) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:37 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75 Sep 28 18:26:37 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:37 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG oslo_concurrency.processutils [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b11ebd30d3ac50e681d4d7678fe37c75" returned: 0 in 0.264s {{(pid=87096) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG cinder.manager [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Notifying Schedulers of capabilities ... {{(pid=87096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:37 devstack cinder-volume[87096]: INFO cinder.volume.manager [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Deleted volume successfully. Sep 28 18:26:37 devstack cinder-volume[87096]: DEBUG cinder.coordination [None req-4dccfd3b-b1bb-4ee0-b8fc-04e385d34607 tempest-ProjectMemberTests-819848877 None] Lock "cinder-beed9afa-85e9-419e-9c01-67e2468921cb-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87096) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:47 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:UPDATE=12,cinder:DELETE=1,cinder:SELECT=10,cinder:INSERT=3 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:47 devstack cinder-volume[87096]: DEBUG dbcounter [-] [87096] Writing DB stats cinder:DELETE=4,cinder:UPDATE=42,cinder:SELECT=31,cinder:INSERT=13 {{(pid=87096) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}